-- Logs begin at Fri 2022-07-15 14:39:30 UTC, end at Fri 2022-07-15 16:00:39 UTC. -- Jul 15 15:17:14.554434 dv-cinder-850015-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 15 15:17:14.563014 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 15 15:17:14.565096 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 15 15:17:14 2022] *** Jul 15 15:17:14.565096 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 15 15:17:14.565096 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 15 15:17:14.565096 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: nodename: dv-cinder-850015-1-iscsi Jul 15 15:17:14.565096 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: machine: x86_64 Jul 15 15:17:14.565096 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: clock source: unix Jul 15 15:17:14.565096 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: pcre jit disabled Jul 15 15:17:14.565096 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: detected number of CPU cores: 4 Jul 15 15:17:14.565096 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: current working directory: / Jul 15 15:17:14.565096 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: detected binary path: /usr/bin/uwsgi-core Jul 15 15:17:14.565787 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: your processes number limit is 47680 Jul 15 15:17:14.565787 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: your memory page size is 4096 bytes Jul 15 15:17:14.565787 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: detected max file descriptor number: 2048 Jul 15 15:17:14.565787 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: lock engine: pthread robust mutexes Jul 15 15:17:14.565787 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: thunder lock: enabled Jul 15 15:17:14.565787 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 15 15:17:14.565787 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 15 15:17:14.604912 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: Python main interpreter initialized at 0x55f6a57ba9c0 Jul 15 15:17:14.604912 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: python threads support enabled Jul 15 15:17:14.604912 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: your server socket listen backlog is limited to 100 connections Jul 15 15:17:14.604912 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: your mercy for graceful operations on workers is 90 seconds Jul 15 15:17:14.605293 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: mapped 403077 bytes (393 KB) for 2 cores Jul 15 15:17:14.605293 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: *** Operational MODE: preforking *** Jul 15 15:17:14.605585 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: *** uWSGI is running in multiple interpreter mode *** Jul 15 15:17:14.605585 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: spawned uWSGI master process (pid: 103270) Jul 15 15:17:14.605791 dv-cinder-850015-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 15 15:17:14.606899 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: spawned uWSGI worker 1 (pid: 103271, cores: 1) Jul 15 15:17:14.606899 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: spawned uWSGI worker 2 (pid: 103272, cores: 1) Jul 15 15:17:14.606899 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 15 15:17:15.257497 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 15 15:17:15.259423 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 15 15:17:16.329073 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 15:17:16.329073 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: from cryptography.utils import int_from_bytes Jul 15 15:17:16.329700 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 15:17:16.329700 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: from cryptography.utils import int_from_bytes Jul 15 15:17:16.331674 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 15:17:16.331674 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: from cryptography.utils import int_from_bytes Jul 15 15:17:16.332131 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 15:17:16.332131 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: from cryptography.utils import int_from_bytes Jul 15 15:17:18.768805 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 15:17:18.769438 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 15:17:18.769611 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 15:17:18.769954 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 15:17:18.770215 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 15:17:18.770605 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.770945 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.771319 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.771666 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.771987 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.772293 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.772614 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.772908 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.773227 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.773424 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 15:17:18.773800 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.773873 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 15:17:18.773937 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.774075 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850015-1-iscsi {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.774208 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 15:17:18.774358 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.774563 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 15:17:18.774709 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.774804 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 15:17:18.775013 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.775210 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.775396 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.775536 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.775643 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.775856 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.775959 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.776170 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.776275 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.776515 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.776651 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.776804 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.777923 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.778031 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.778102 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.778174 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.778239 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.778303 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.778381 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.778449 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.778699 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.778847 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.779028 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.779211 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850015-1-iscsi {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.779381 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.779505 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.779626 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.779752 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.779879 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.779996 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.780123 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.780246 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.780246 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.780519 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850015-1-iscsi {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.780519 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.780757 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.780897 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.781023 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.781147 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.781530 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.781694 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.781865 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.781978 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.782096 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.782234 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.782371 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.782501 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.782658 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.782827 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.782951 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.783069 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.783199 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.783404 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.783580 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.783710 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.783866 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.784003 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.784140 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.784272 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.784393 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.784598 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.784790 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850015-1-iscsi {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.784924 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.785124 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.785263 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.785457 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.785550 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.785757 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.785862 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.786053 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.786204 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.786292 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.786545 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.786634 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.787023 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.787123 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.787370 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.787459 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.787716 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.787804 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.788016 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.788112 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.788266 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.788389 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.788580 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.788730 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.788895 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.789072 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.789202 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.789410 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.789497 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.789732 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.789834 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.790041 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.790127 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.790366 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.790459 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.790705 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.790803 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.791008 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.791102 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.791308 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.791393 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.791610 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.791703 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.791916 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.792027 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.792331 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.792418 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.792636 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.792734 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.792952 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.793037 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.793255 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.793340 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.793527 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.793614 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.793865 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.793983 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.794191 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.794277 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.794503 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.794618 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.794830 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.794916 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.795143 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.795294 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.795461 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.795557 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.795765 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.795850 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.796067 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.796162 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.796371 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.796457 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.796685 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.796771 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.797012 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.797112 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.797312 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.797406 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.797557 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.797651 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.797854 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.797948 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.798155 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.798286 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.798467 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.798745 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.798845 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.798997 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.799092 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.799322 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.799418 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.799652 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.799752 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.799963 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.800048 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.800265 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.800351 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.800569 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.800667 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.800872 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.800968 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.801175 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.801269 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.801476 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.801644 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.801778 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.801872 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.802080 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.802194 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.802470 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.802628 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.802803 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.802937 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.803120 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.803206 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.803423 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.803509 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.803731 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.803817 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.804026 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.804125 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.804329 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.804422 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.804644 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.804767 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.804945 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.805081 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.805247 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.805381 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.805562 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.805687 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.805868 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.805994 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.806168 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.806302 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.806480 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.806633 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.806810 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.806938 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.807116 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.807240 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.807429 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.807544 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.807725 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.807848 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.808027 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.808151 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.808335 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.808466 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.808638 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.808786 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.808940 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.809128 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.809230 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.809389 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.809528 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.809691 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.809833 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.809995 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.810134 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.810309 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.810432 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.810636 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.810765 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.810941 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.811068 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.811257 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.811381 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.811560 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.811697 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.811865 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.812003 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.812177 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.812306 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.812482 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.812607 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.812785 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.812918 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.813100 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.813251 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.813398 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.813576 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.813700 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.813911 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.813995 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.814221 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.814308 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.814574 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.814664 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.814902 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.814998 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.815208 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.815299 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.815511 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.815595 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.815814 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.815898 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.816115 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.816201 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.816416 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.816500 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.816711 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.816814 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.817017 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.817101 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.817333 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.817417 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.817639 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.817738 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.817966 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.818076 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.818298 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.818386 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.818639 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.818817 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:17:18.818956 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.819155 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.819263 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.819484 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.819570 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.819825 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.819911 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.820139 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.820223 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.820470 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.820570 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.820799 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.820894 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.821115 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.821200 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.821427 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.821519 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.821738 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.821823 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.822056 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.822141 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.822363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.822586 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.822696 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.822782 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.823002 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.823087 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.823317 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.823414 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.823631 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.823715 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.823935 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.824020 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.824247 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.824346 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.824561 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.824654 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.824875 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.824961 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.825179 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.825273 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.825483 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.825618 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.825789 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.825875 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.826115 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.826214 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.826420 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.826536 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.826763 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.826873 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.827069 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.827241 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.827375 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.827576 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.827667 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.827912 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.828006 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.828260 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.828347 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.828563 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.828648 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.828855 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.828964 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.829155 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.829247 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.829458 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.829544 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.829762 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.829858 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.830077 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.830163 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.830397 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.830482 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.830730 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.830819 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.831072 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.831158 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.831373 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.831460 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.831676 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.831763 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.831981 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.832073 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.832286 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.832397 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.832585 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.832730 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.832890 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.833047 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.833194 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.833378 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.833493 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.833767 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.833962 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.834190 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.834312 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.834509 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.834686 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.835010 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.835313 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.835615 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.835927 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.836234 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.836541 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.836625 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.836852 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.836944 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.837161 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.837300 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.837480 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.837603 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.837786 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.837930 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.838094 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.838247 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.838420 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.838609 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.838771 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.838946 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.839075 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.839261 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.839396 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.839597 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.839722 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.839910 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.840034 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.840226 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.840333 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.840542 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.840628 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.840861 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.840962 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.841168 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.841261 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.841483 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.841608 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.841787 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.841884 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.842086 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.842172 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.842386 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.842476 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.842721 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.842815 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.843020 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.843106 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.843317 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.843402 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.843631 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.843719 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.843935 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.844019 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.844231 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.844315 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.844530 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.844618 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.844841 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.844984 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.845164 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.845261 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.845465 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.845555 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.845802 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.845894 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.846131 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.846226 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.846446 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.846553 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.846790 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.846886 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.847100 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.847199 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.847413 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.847505 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.847720 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.847814 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.848386 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.848492 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.848692 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.848779 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.848998 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.849084 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.849390 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.849485 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.849712 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.849931 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.850042 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.850262 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.850357 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.850600 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.850691 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.850921 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.851005 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.851226 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.851330 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.851532 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.851618 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.851833 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.851917 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.852133 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.852275 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.852453 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.852549 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.852761 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.852855 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.853064 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.853234 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.853368 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.853467 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.853668 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.853761 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.853976 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.854074 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.854282 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.854383 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.854618 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.854707 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.854925 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.855051 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.855231 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.855317 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.855548 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.855665 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.855853 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.855967 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.856164 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.856268 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.856468 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.856559 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.856787 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.856927 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.857086 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.857163 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.857395 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.857480 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.857691 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.857777 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.857998 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.858092 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.858319 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.858413 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.858670 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.858760 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.858978 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.859063 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.859286 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.859385 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.859611 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.859697 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.859917 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.860002 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.860223 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.860319 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.860529 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.860614 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.860829 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.860916 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.861129 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.861223 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.861437 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.861531 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.861758 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.861842 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.862061 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.862183 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.862361 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.862451 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.862686 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.862786 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.863000 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.863087 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.863304 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.863438 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.863602 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.863698 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.863900 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.863987 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.864209 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.864304 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.864523 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.864610 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.864858 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.865106 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.865214 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.865448 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.865583 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.865773 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.865874 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.866080 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.866168 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.866393 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.866486 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.866723 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.866812 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.867023 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.867122 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.867323 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.867410 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.867622 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.867719 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.867957 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.868043 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.868263 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.868358 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.868563 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.868650 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.868874 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.868959 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.869179 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.869262 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.869484 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.869570 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.869796 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.869881 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.870101 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.870195 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.870406 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.870499 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.870739 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.870826 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.871043 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.871142 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.871345 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.871430 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.871650 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.871740 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.871953 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.872048 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.872255 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.872341 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.872556 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.872646 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.872871 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.872967 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.873182 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.873267 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.873486 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.873571 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.873792 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.873879 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.874088 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.874173 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.874387 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.874472 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.874723 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.874811 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.875032 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.875302 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.875387 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.875624 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.875716 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.875930 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.876016 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.876245 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.876332 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.876556 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.876655 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.876856 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.876940 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.877175 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.877261 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.877497 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.877583 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.877804 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.877896 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.878120 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.878219 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.878424 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.878509 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.878829 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.878917 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.879130 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.879223 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.879446 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.879617 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.879746 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.879831 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.880047 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.880150 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.880352 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.880447 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.880687 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.880771 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.880985 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.881069 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.881284 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.881380 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.881584 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.881681 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.881882 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.881978 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.882188 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.882281 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.882487 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.882648 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.882818 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.882904 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.883118 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.883206 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.883433 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.883694 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.883779 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.884039 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.884138 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.884321 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.884407 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.884619 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.884711 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.884955 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.885051 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.885253 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.885375 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.885581 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.885667 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.885901 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.885989 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.886237 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.886331 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.886554 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.886654 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.886859 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.886946 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.887164 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.887249 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.887464 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.887548 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.887763 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.887858 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.888060 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.888158 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.888363 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.888455 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.888664 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.888760 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.888965 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.889058 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.889265 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.889349 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.889568 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.889669 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.889870 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.889955 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.890171 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.890257 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.890466 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.890577 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.890796 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.890883 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.891094 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.891180 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.891402 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.891487 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.891703 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.891789 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.892002 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.892087 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.892300 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.892393 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.892602 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.892685 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.892902 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.892994 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.893198 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.893285 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.893501 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.893589 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.893797 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.893883 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.894106 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.894192 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.894403 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.894495 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.894726 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.894826 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.895027 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.895120 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.895331 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.895454 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.895636 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.895735 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.895933 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.896019 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.896309 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.896396 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.896622 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.896717 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.896931 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.897019 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.897233 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.897317 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.897545 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.897639 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.897853 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.897937 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.898151 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.898237 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.898459 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.898563 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.898788 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.898882 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.899097 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.899190 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.899401 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.899488 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.899706 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.899789 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.900008 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.900095 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.900309 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.900394 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.900605 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.900698 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.900910 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.900995 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.901207 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.901294 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.901504 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.901590 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.901801 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.901897 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.902098 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.902183 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.902392 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.902485 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.902726 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.902825 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.903029 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.903117 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.903330 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.903416 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.903626 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.903722 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.903927 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.904013 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.904231 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.904322 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.904553 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.904653 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.904865 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.904952 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.905172 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.905257 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.905481 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.905612 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.905790 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.905883 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.906095 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.906180 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.906400 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.906495 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.906732 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.906819 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.907032 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.907116 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.907343 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.907430 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.907647 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.907740 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.907952 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.908038 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.908251 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.908338 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.908549 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.908635 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.908858 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.908956 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.909160 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.909256 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.909461 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.909544 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.909763 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.909858 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.910065 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.910150 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.910366 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.910451 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.910694 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.910796 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.911017 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.911102 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.911328 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.911412 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.911631 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.911745 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.911961 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.912078 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.912344 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.912430 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.912683 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.912770 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.912996 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.913081 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.913302 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.913387 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.913608 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.913695 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.913912 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.913997 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.914213 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.914298 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.914532 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.914621 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.914844 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.914942 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.915144 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.915229 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.915462 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.915556 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.915767 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.915856 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.916065 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.916161 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.916369 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.916461 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.916667 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.916753 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.916973 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.917068 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.917271 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.917366 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.917690 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.917775 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.917993 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.918088 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.918298 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.918384 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.918624 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.918725 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.918931 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.919026 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.919235 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.919321 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.919548 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.919635 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.919857 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.919955 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.920153 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.920238 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.920460 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.920543 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.920771 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.920890 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.921084 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.921175 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.921396 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.921499 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.921706 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.921806 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.921998 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.922089 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.922298 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.922384 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.922625 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.922712 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.922923 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.923010 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.923221 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.923318 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.923517 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.923604 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.923830 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.923924 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.924127 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.924221 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.924425 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.924509 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.924734 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.924825 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.925036 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.925139 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.925350 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.925437 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.925652 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.925799 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.926079 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.926174 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.926388 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.926474 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.926720 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.926808 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.927024 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.927120 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.927393 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.927482 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.927701 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.927786 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.928012 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.928099 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.928318 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.928404 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.928641 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.928728 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.928959 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.929089 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.929266 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.929401 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.929580 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.929711 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.929881 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.930019 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.930200 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.930321 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.930543 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.930645 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.930845 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.930931 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.931161 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.931247 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.931533 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.931627 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.931834 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.931920 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.932134 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.932231 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.932452 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.932538 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.932754 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.932853 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.933052 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.933144 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.933350 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.933469 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.933654 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.933783 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.933954 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.934089 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.934258 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.934498 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.934650 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.934836 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.934924 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.935145 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.935230 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.935467 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.935552 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.935773 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.935901 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.936071 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.936158 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.936369 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.936470 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.936679 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.936815 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.937302 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.937420 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.937533 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.937653 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.937759 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.937864 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.937975 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.938088 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.938200 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.938317 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.938460 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.938621 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.938802 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.938915 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.939108 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.939242 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.939413 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.939534 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.939713 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.939831 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.940012 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.940126 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.940345 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.940457 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.940646 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.940788 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.940960 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.941111 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.941283 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.941433 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.941603 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.941738 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.941908 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.942080 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.942233 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.942391 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.942640 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.942769 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.942987 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.943134 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.943299 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.943559 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.943670 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.943919 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.944582 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.944702 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.944816 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.944942 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.945099 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.945207 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.945311 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.945427 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.945531 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.945531 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.945732 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.945838 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.945952 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.946056 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.946168 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.946280 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.946410 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.946501 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.946603 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.946799 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.946899 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.947098 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.947185 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.947412 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.947497 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.947715 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.947799 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.948012 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.948099 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.948311 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.948398 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.948607 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.948692 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.948912 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.948998 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.949227 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.949312 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.949540 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.949624 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.949860 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.949955 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.950175 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.950261 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.950497 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.950656 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.950829 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.950919 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.951146 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.951233 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.951459 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.951628 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.951773 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.951858 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.952081 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.952169 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.952393 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.952489 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.952695 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.952781 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.952999 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.953084 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.953309 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.953404 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.953618 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.953704 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.953928 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.954014 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.954239 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.954363 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.954576 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.954668 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.954892 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.955113 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.955214 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.955440 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.955527 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.955755 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.955842 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.956068 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.956199 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.956378 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.956477 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.956690 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.956784 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.957000 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.957096 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.957310 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.957403 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.957614 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.957699 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.957920 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.958013 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.958229 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.958316 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.958729 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.958866 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.959067 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.959203 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.959315 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.959412 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.959647 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.959742 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.959960 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.960050 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.960272 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.960358 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.960582 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.960681 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.960891 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.960978 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.961222 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.961307 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.961539 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.961648 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.961840 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.961926 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.962147 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.962241 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.962457 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.962600 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.962793 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.962878 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.963103 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.963198 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.963408 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.963503 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.963716 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.963810 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.964021 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.964274 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.964370 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.964614 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.964700 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.964916 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.965002 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.965224 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.965319 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.965539 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.965624 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.965854 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.965940 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.966165 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.966302 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.966472 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.966579 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.966805 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.966892 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.967115 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.967203 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.967428 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.967631 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.967754 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.967944 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.968074 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.968274 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.968398 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.968594 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.968730 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.968913 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.969044 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.969229 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.969357 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.969545 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.969672 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.969866 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.969983 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.970168 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.970336 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.970469 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.970676 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.970803 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.970982 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.971109 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.971294 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.971407 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.971606 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.971723 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.971917 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.972031 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.972226 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.972319 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.972535 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.972622 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.972844 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.972930 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.973518 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.973804 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.973900 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.974151 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.974304 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.974499 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.974679 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.974841 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.975044 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.975161 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.975402 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.975489 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.975756 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.975852 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.976071 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.976157 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.976372 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.976502 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.976671 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.976773 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.976981 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.977068 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.977287 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.977548 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.977633 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.977877 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.977964 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.978183 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.978270 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.978488 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.978628 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.978811 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.978899 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.979116 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.979202 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.979420 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.979515 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.979743 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.979838 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.980044 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.980131 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.980344 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.980438 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.980643 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.980729 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.980949 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.981043 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.981249 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.981344 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.981548 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.981700 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.981846 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.981935 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.982144 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.982232 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.982449 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.982554 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.982772 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.982870 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.983080 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.983328 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.983414 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.983672 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.983757 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.983969 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.984066 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.984272 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.984358 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.984603 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.984688 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.984921 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.985016 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.985220 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.985315 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.985517 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.985603 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.985827 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.985929 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.986132 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.986227 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.986447 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.986618 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.986780 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.986870 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.987086 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.987172 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.987426 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.987511 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.987737 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.987823 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.988045 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.988266 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.988360 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.988599 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.988764 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.988915 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.989002 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.989237 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.989331 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.989541 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.989629 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.989911 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.990004 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.990231 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.990325 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.990624 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.990724 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.990934 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.991051 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.991239 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.991366 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.991545 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.991677 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.991851 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.991988 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.992160 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.992300 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.992464 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.992606 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.992792 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.992915 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.993099 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.993223 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.993431 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.993517 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.993755 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.993841 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.994086 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.994231 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.994409 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.994496 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.994740 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.994861 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.995045 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.995143 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.995352 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.995440 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.995685 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.995771 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.995999 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.996087 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.996306 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.996421 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.996617 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.996747 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.996929 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.997071 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.997235 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.997438 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.997544 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.997780 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.997875 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.998134 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.998331 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.998444 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.998709 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.998810 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.999053 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.999154 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.999377 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.999463 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.999724 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:18.999819 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.000053 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.000139 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.000378 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.000463 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.000699 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.000797 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.001007 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.001096 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.001322 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.001410 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.001639 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.001734 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.001945 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.002032 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.002263 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.002356 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.002591 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.002692 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.002917 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.003011 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.003248 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.003334 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.003571 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.003659 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.003889 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.003976 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.004190 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.004276 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.004490 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.004578 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.004789 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.004875 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.005094 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.005189 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.005405 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.005531 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.005863 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.005949 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.006182 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.006278 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.006488 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.006601 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.006835 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.006973 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.007138 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.007312 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.007438 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.007623 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.007737 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.007954 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.008041 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.008284 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.008377 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.008610 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.008696 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.008907 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.009070 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.009206 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.009294 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.009488 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.009574 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.009787 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.009887 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.010081 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.010305 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.010435 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.010639 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.010733 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.010980 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.011068 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.011276 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.011364 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.011573 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.011667 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.011868 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.011977 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.012190 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.012305 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.012519 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.012614 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.012832 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.012917 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.013150 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.013236 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.013459 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.013556 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.013775 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.013871 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.014078 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.014164 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.014396 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.014484 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.014738 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.014826 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.015051 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.015136 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.015359 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.015454 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.015677 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.015764 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.015983 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.016068 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.016290 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.016382 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.016593 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.016679 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.016895 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.016993 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.017203 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.017290 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.017504 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.017589 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.017805 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.017966 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.018108 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.018194 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.018409 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.018494 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.018742 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.018888 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.019040 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.019134 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.019339 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.019434 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.019638 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.019734 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.019938 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.020025 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.020239 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.020331 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.020539 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.020626 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.020842 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.020929 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.021186 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.021282 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.021492 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.021587 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.021793 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.021891 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.022092 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.022200 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.022391 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.022512 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.022742 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.022829 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.023073 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.023158 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.023386 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.023474 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.023705 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.023798 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.024012 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.024113 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.024330 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.024424 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.024637 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.024730 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.024955 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.025051 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.025279 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.025372 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.025590 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.025675 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.025895 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.025993 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.026229 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.026327 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.026552 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.026641 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.026866 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.026966 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.027167 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.027257 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.027406 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 15:17:19.027493 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.027835 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.028165 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.028493 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.028848 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.029163 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.029512 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.029852 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.030194 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.030539 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.030889 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.031241 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.031582 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.031888 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.032217 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.032549 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.032873 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.033230 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.033541 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.033851 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.034193 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.034561 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.034889 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.035219 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.035547 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.035908 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.036254 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.036613 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.036954 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.037296 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.037619 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.037931 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.038262 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.038602 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:17:19.040579 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 15:17:19.088593 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO dbcounter [None req-48062932-549d-46d0-9703-b3bb218ebfdb None None] Registered counter for database nova_api Jul 15 15:17:19.103126 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO dbcounter [None req-27af5e73-c71d-41c6-8d67-d669175db276 None None] Registered counter for database nova_api Jul 15 15:17:19.206107 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG oslo_db.sqlalchemy.engines [None req-48062932-549d-46d0-9703-b3bb218ebfdb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:17:19.213487 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writer thread running {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:17:19.218805 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_db.sqlalchemy.engines [None req-27af5e73-c71d-41c6-8d67-d669175db276 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:17:19.226420 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writer thread running {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:17:19.269868 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.context [None req-48062932-549d-46d0-9703-b3bb218ebfdb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),11a29c77-701d-47b2-97de-2677c43340d0(cell1) {{(pid=103272) load_cells /opt/stack/nova/nova/context.py:464}} Jul 15 15:17:19.274145 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-48062932-549d-46d0-9703-b3bb218ebfdb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:17:19.275751 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-48062932-549d-46d0-9703-b3bb218ebfdb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:17:19.276588 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-48062932-549d-46d0-9703-b3bb218ebfdb None None] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:17:19.278745 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-48062932-549d-46d0-9703-b3bb218ebfdb None None] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:17:19.280730 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO dbcounter [None req-48062932-549d-46d0-9703-b3bb218ebfdb None None] Registered counter for database nova_cell0 Jul 15 15:17:19.283979 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.context [None req-27af5e73-c71d-41c6-8d67-d669175db276 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),11a29c77-701d-47b2-97de-2677c43340d0(cell1) {{(pid=103271) load_cells /opt/stack/nova/nova/context.py:464}} Jul 15 15:17:19.284643 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO dbcounter [None req-48062932-549d-46d0-9703-b3bb218ebfdb None None] Registered counter for database nova_cell1 Jul 15 15:17:19.288297 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-27af5e73-c71d-41c6-8d67-d669175db276 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:17:19.289898 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-27af5e73-c71d-41c6-8d67-d669175db276 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:17:19.290728 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-27af5e73-c71d-41c6-8d67-d669175db276 None None] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:17:19.292819 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG oslo_db.sqlalchemy.engines [None req-48062932-549d-46d0-9703-b3bb218ebfdb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:17:19.292975 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-27af5e73-c71d-41c6-8d67-d669175db276 None None] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:17:19.294562 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG oslo_db.sqlalchemy.engines [None req-48062932-549d-46d0-9703-b3bb218ebfdb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:17:19.294979 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO dbcounter [None req-27af5e73-c71d-41c6-8d67-d669175db276 None None] Registered counter for database nova_cell0 Jul 15 15:17:19.298883 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO dbcounter [None req-27af5e73-c71d-41c6-8d67-d669175db276 None None] Registered counter for database nova_cell1 Jul 15 15:17:19.300164 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writer thread running {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:17:19.305544 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writer thread running {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:17:19.306129 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_db.sqlalchemy.engines [None req-27af5e73-c71d-41c6-8d67-d669175db276 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:17:19.309253 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_db.sqlalchemy.engines [None req-27af5e73-c71d-41c6-8d67-d669175db276 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:17:19.313089 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writer thread running {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:17:19.318917 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writer thread running {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:17:19.453107 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO dbcounter [None req-48062932-549d-46d0-9703-b3bb218ebfdb None None] Registered counter for database nova_cell0 Jul 15 15:17:19.462260 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG oslo_db.sqlalchemy.engines [None req-48062932-549d-46d0-9703-b3bb218ebfdb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:17:19.464466 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO dbcounter [None req-27af5e73-c71d-41c6-8d67-d669175db276 None None] Registered counter for database nova_cell0 Jul 15 15:17:19.467350 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writer thread running {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:17:19.473754 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG oslo_db.sqlalchemy.engines [None req-27af5e73-c71d-41c6-8d67-d669175db276 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:17:19.478884 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writer thread running {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:17:19.803885 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: WARNING keystonemiddleware.auth_token [None req-48062932-549d-46d0-9703-b3bb218ebfdb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 15:17:19.810607 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: WARNING keystonemiddleware.auth_token [None req-27af5e73-c71d-41c6-8d67-d669175db276 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 15:17:19.811272 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: WARNING keystonemiddleware.auth_token [None req-48062932-549d-46d0-9703-b3bb218ebfdb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 15:17:19.818283 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: WARNING keystonemiddleware.auth_token [None req-27af5e73-c71d-41c6-8d67-d669175db276 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 15:17:20.155458 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: WARNING keystonemiddleware.auth_token [None req-48062932-549d-46d0-9703-b3bb218ebfdb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 15:17:20.161336 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: WARNING keystonemiddleware.auth_token [None req-48062932-549d-46d0-9703-b3bb218ebfdb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 15:17:20.164679 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: WARNING keystonemiddleware.auth_token [None req-27af5e73-c71d-41c6-8d67-d669175db276 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 15:17:20.166775 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f6a57ba9c0 pid: 103272 (default app) Jul 15 15:17:20.168844 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-48062932-549d-46d0-9703-b3bb218ebfdb None None] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:17:20.170149 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-48062932-549d-46d0-9703-b3bb218ebfdb None None] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001838 Jul 15 15:17:20.170555 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 788 bytes} [Fri Jul 15 15:17:20 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:17:20.170777 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: WARNING keystonemiddleware.auth_token [None req-27af5e73-c71d-41c6-8d67-d669175db276 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 15:17:20.175950 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f6a57ba9c0 pid: 103271 (default app) Jul 15 15:18:37.446564 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-48062932-549d-46d0-9703-b3bb218ebfdb None None] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:18:37.447629 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-48062932-549d-46d0-9703-b3bb218ebfdb None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Jul 15 15:18:37.448089 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 2/2] 10.222.0.40 () {54 vars in 930 bytes} [Fri Jul 15 15:18:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:18:37.461629 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_api:SELECT=3 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:37.462978 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_cell0:SELECT=3 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:37.463792 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_cell1:SELECT=3 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:37.465210 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:38.364002 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-d7dd543e-93ce-4718-9881-8f0d38d1333d admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:18:38.397298 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-d7dd543e-93ce-4718-9881-8f0d38d1333d admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.941520 Jul 15 15:18:38.398099 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 1/3] 10.222.0.40 () {60 vars in 1291 bytes} [Fri Jul 15 15:18:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:18:40.600472 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-48062932-549d-46d0-9703-b3bb218ebfdb None None] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:18:40.602010 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-48062932-549d-46d0-9703-b3bb218ebfdb None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001887 Jul 15 15:18:40.602982 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 3/4] 10.222.0.40 () {54 vars in 930 bytes} [Fri Jul 15 15:18:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:18:41.101038 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-3d2c58c0-756c-45c9-8bff-38641ba52599 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 256, "disk": 1, "swap": 0, "name": "cirros256", "id": "c1", "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:18:41.119348 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:18:41.119348 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: warnings.warn(msg) Jul 15 15:18:41.152164 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-3d2c58c0-756c-45c9-8bff-38641ba52599 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.539189 Jul 15 15:18:41.153445 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 2/5] 10.222.0.40 () {64 vars in 1282 bytes} [Fri Jul 15 15:18:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:18:41.167122 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_api:SELECT=3 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:41.168103 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_cell0:SELECT=3 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:41.168848 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_cell1:SELECT=3 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:41.170173 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:18:41.377673 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-de89b030-9e62-45ef-a5a3-3a91509a2a90 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:18:41.380178 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:18:41.380178 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: warnings.warn(msg) Jul 15 15:18:41.443966 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-de89b030-9e62-45ef-a5a3-3a91509a2a90 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282413 Jul 15 15:18:41.444741 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 4/6] 10.222.0.40 () {64 vars in 1335 bytes} [Fri Jul 15 15:18:41 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:18:43.651107 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-3d2c58c0-756c-45c9-8bff-38641ba52599 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:18:43.652172 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-3d2c58c0-756c-45c9-8bff-38641ba52599 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001643 Jul 15 15:18:43.652808 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 3/7] 10.222.0.40 () {54 vars in 930 bytes} [Fri Jul 15 15:18:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:18:44.334473 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-a4795fc9-4f77-4535-af01-d6b33d22517c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds512M", "ram": 512, "id": "d1", "vcpus": 1}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:18:44.353618 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:18:44.353618 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: warnings.warn(msg) Jul 15 15:18:44.374870 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-a4795fc9-4f77-4535-af01-d6b33d22517c admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.715538 Jul 15 15:18:44.375583 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 5/8] 10.222.0.40 () {64 vars in 1282 bytes} [Fri Jul 15 15:18:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:18:44.389132 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-687b0299-b2aa-473b-bf57-5ce8524fb528 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:18:44.391305 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:18:44.391305 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: warnings.warn(msg) Jul 15 15:18:44.428739 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-687b0299-b2aa-473b-bf57-5ce8524fb528 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044454 Jul 15 15:18:44.438186 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 4/9] 10.222.0.40 () {64 vars in 1335 bytes} [Fri Jul 15 15:18:44 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:18:46.717549 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-a4795fc9-4f77-4535-af01-d6b33d22517c admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:18:46.718807 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-a4795fc9-4f77-4535-af01-d6b33d22517c admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 15 15:18:46.719477 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 6/10] 10.222.0.40 () {54 vars in 930 bytes} [Fri Jul 15 15:18:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:18:47.177487 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-9e729096-ae5e-4ab9-8cf5-d509afed5b3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 1, "id": "d2", "os-flavor-access:is_public": true, "ram": 1024, "swap": 0, "rxtx_factor": 1.0, "name": "ds1G"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:18:47.196260 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-9e729096-ae5e-4ab9-8cf5-d509afed5b3e admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.471617 Jul 15 15:18:47.196794 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 5/11] 10.222.0.40 () {64 vars in 1282 bytes} [Fri Jul 15 15:18:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:18:47.209080 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-8ac547ee-bd47-4ed1-a40c-ef2782cff4f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:18:47.232272 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-8ac547ee-bd47-4ed1-a40c-ef2782cff4f2 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027021 Jul 15 15:18:47.232826 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 7/12] 10.222.0.40 () {64 vars in 1335 bytes} [Fri Jul 15 15:18:47 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:18:49.403853 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-9e729096-ae5e-4ab9-8cf5-d509afed5b3e admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:18:49.405530 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-9e729096-ae5e-4ab9-8cf5-d509afed5b3e admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002407 Jul 15 15:18:49.405928 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 6/13] 10.222.0.40 () {54 vars in 930 bytes} [Fri Jul 15 15:18:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:18:49.861509 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-a7f5f227-e1bd-485e-87d3-ab9689d1326b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds2G", "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 2048, "id": "d3", "rxtx_factor": 1.0}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:18:49.882593 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-a7f5f227-e1bd-485e-87d3-ab9689d1326b admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.470099 Jul 15 15:18:49.890582 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 8/14] 10.222.0.40 () {64 vars in 1282 bytes} [Fri Jul 15 15:18:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:18:49.896938 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-02de5789-ac1a-40a5-a1f4-64e1a10445c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:18:49.941749 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-02de5789-ac1a-40a5-a1f4-64e1a10445c1 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048786 Jul 15 15:18:49.942803 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 7/15] 10.222.0.40 () {64 vars in 1335 bytes} [Fri Jul 15 15:18:49 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:18:52.177613 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-a7f5f227-e1bd-485e-87d3-ab9689d1326b admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:18:52.178662 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-a7f5f227-e1bd-485e-87d3-ab9689d1326b admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 15 15:18:52.179030 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 9/16] 10.222.0.40 () {54 vars in 930 bytes} [Fri Jul 15 15:18:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:18:52.617833 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-2fc32456-963f-4c90-a01e-e0be34a10843 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "disk": 20, "vcpus": 4, "name": "ds4G"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:18:52.637283 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-2fc32456-963f-4c90-a01e-e0be34a10843 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.450444 Jul 15 15:18:52.642951 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 8/17] 10.222.0.40 () {64 vars in 1282 bytes} [Fri Jul 15 15:18:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:18:52.650062 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-41b625b3-f125-49f6-a1e2-487c5b1c6572 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:18:52.675438 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-41b625b3-f125-49f6-a1e2-487c5b1c6572 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029106 Jul 15 15:18:52.676017 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 10/18] 10.222.0.40 () {64 vars in 1335 bytes} [Fri Jul 15 15:18:52 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:18:54.944401 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-2fc32456-963f-4c90-a01e-e0be34a10843 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:18:54.945557 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-2fc32456-963f-4c90-a01e-e0be34a10843 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001646 Jul 15 15:18:54.946200 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 9/19] 10.222.0.40 () {54 vars in 930 bytes} [Fri Jul 15 15:18:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:18:55.416638 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-97f0f53e-7a36-4535-871a-41f28895ee10 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:18:55.440748 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-97f0f53e-7a36-4535-871a-41f28895ee10 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.487798 Jul 15 15:18:55.441303 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 11/20] 10.222.0.40 () {60 vars in 1291 bytes} [Fri Jul 15 15:18:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:18:57.995600 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-2fc32456-963f-4c90-a01e-e0be34a10843 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:18:57.996573 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-2fc32456-963f-4c90-a01e-e0be34a10843 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002556 Jul 15 15:18:57.996985 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 10/21] 10.222.0.40 () {54 vars in 930 bytes} [Fri Jul 15 15:18:57 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:18:58.449120 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-78923ece-3542-4ded-a1fe-0b8c7d3484c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "1", "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "m1.tiny", "rxtx_factor": 1.0}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:18:58.470375 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-78923ece-3542-4ded-a1fe-0b8c7d3484c4 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.466709 Jul 15 15:18:58.471188 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 12/22] 10.222.0.40 () {64 vars in 1282 bytes} [Fri Jul 15 15:18:58 2022] POST /compute/v2.1/flavors => generated 402 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:18:58.487533 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-5563b321-d1ff-4212-ad1d-56b487040469 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:18:58.518468 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-5563b321-d1ff-4212-ad1d-56b487040469 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036516 Jul 15 15:18:58.519097 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 11/23] 10.222.0.40 () {64 vars in 1332 bytes} [Fri Jul 15 15:18:58 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:19:00.851756 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-78923ece-3542-4ded-a1fe-0b8c7d3484c4 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:19:00.852761 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-78923ece-3542-4ded-a1fe-0b8c7d3484c4 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 15 15:19:00.853153 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 930 bytes} [Fri Jul 15 15:19:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:19:01.267171 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-33083779-c34d-41aa-b061-c6c83f9e680b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.small", "ram": 2048, "swap": 0, "disk": 20}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:19:01.285899 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-33083779-c34d-41aa-b061-c6c83f9e680b admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.426507 Jul 15 15:19:01.286811 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 12/25] 10.222.0.40 () {64 vars in 1282 bytes} [Fri Jul 15 15:19:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:19:01.299071 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-3d5e1274-d1e9-40f8-b495-2712b9aa2f1e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:19:01.323649 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-3d5e1274-d1e9-40f8-b495-2712b9aa2f1e admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028319 Jul 15 15:19:01.324268 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 14/26] 10.222.0.40 () {64 vars in 1332 bytes} [Fri Jul 15 15:19:01 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:19:03.537613 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-33083779-c34d-41aa-b061-c6c83f9e680b admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:19:03.538675 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-33083779-c34d-41aa-b061-c6c83f9e680b admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 15 15:19:03.539072 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 13/27] 10.222.0.40 () {54 vars in 930 bytes} [Fri Jul 15 15:19:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:19:03.905030 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-43ed2b22-5125-4f9e-b5eb-a397124c8393 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "os-flavor-access:is_public": true, "name": "m1.medium", "ram": 4096, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "3", "swap": 0}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:19:03.925781 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-43ed2b22-5125-4f9e-b5eb-a397124c8393 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.380861 Jul 15 15:19:03.926335 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 15/28] 10.222.0.40 () {64 vars in 1282 bytes} [Fri Jul 15 15:19:03 2022] POST /compute/v2.1/flavors => generated 406 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:19:03.938311 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-e63d5d4a-1895-414b-847b-2e958bb9fe7f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:19:03.966867 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-e63d5d4a-1895-414b-847b-2e958bb9fe7f admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032216 Jul 15 15:19:03.979092 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 14/29] 10.222.0.40 () {64 vars in 1332 bytes} [Fri Jul 15 15:19:03 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:19:06.240025 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-43ed2b22-5125-4f9e-b5eb-a397124c8393 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:19:06.241885 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-43ed2b22-5125-4f9e-b5eb-a397124c8393 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002409 Jul 15 15:19:06.242657 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 16/30] 10.222.0.40 () {54 vars in 930 bytes} [Fri Jul 15 15:19:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:19:06.729773 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-5aa24c78-5f85-45d2-a5e8-c86118afc8aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "swap": 0, "disk": 80, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192, "id": "4"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:19:06.749688 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-5aa24c78-5f85-45d2-a5e8-c86118afc8aa admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.500849 Jul 15 15:19:06.750247 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 15/31] 10.222.0.40 () {64 vars in 1282 bytes} [Fri Jul 15 15:19:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:19:06.762589 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-1fcf8afe-5bc2-46f7-bb01-d27f8794f115 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:19:06.788475 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-1fcf8afe-5bc2-46f7-bb01-d27f8794f115 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029795 Jul 15 15:19:06.789059 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 17/32] 10.222.0.40 () {64 vars in 1332 bytes} [Fri Jul 15 15:19:06 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:19:09.132677 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-5aa24c78-5f85-45d2-a5e8-c86118afc8aa admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:19:09.134916 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-5aa24c78-5f85-45d2-a5e8-c86118afc8aa admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002472 Jul 15 15:19:09.135501 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 16/33] 10.222.0.40 () {54 vars in 930 bytes} [Fri Jul 15 15:19:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:19:09.580188 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-75b5b9e0-6578-45a3-a1d5-3b2f97a05bf4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "swap": 0, "ram": 16384, "disk": 160, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.xlarge", "id": "5"}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:19:09.598663 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-75b5b9e0-6578-45a3-a1d5-3b2f97a05bf4 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.457229 Jul 15 15:19:09.599208 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 18/34] 10.222.0.40 () {64 vars in 1282 bytes} [Fri Jul 15 15:19:09 2022] POST /compute/v2.1/flavors => generated 408 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:19:09.611771 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-a322b9ea-e9cb-421e-ab34-7113b3ea2774 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:19:09.618901 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:09.637105 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-a322b9ea-e9cb-421e-ab34-7113b3ea2774 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029026 Jul 15 15:19:09.637970 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 17/35] 10.222.0.40 () {64 vars in 1332 bytes} [Fri Jul 15 15:19:09 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:19:29.319238 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-75b5b9e0-6578-45a3-a1d5-3b2f97a05bf4 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:19:29.320353 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-75b5b9e0-6578-45a3-a1d5-3b2f97a05bf4 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001667 Jul 15 15:19:29.320751 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 19/36] 10.222.0.40 () {54 vars in 930 bytes} [Fri Jul 15 15:19:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:19:29.731587 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-dbea8d66-7912-4b32-a895-756f39e0b4fc admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:19:29.748584 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-dbea8d66-7912-4b32-a895-756f39e0b4fc admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.421496 Jul 15 15:19:29.749103 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1291 bytes} [Fri Jul 15 15:19:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:19:30.881611 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-75b5b9e0-6578-45a3-a1d5-3b2f97a05bf4 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:19:30.882863 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-75b5b9e0-6578-45a3-a1d5-3b2f97a05bf4 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001745 Jul 15 15:19:30.883261 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 20/38] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Jul 15 15:19:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:19:31.470373 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-a1eb6d1f-002a-4e0d-95ba-353a623b9d7b admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:19:31.476638 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.wsgi [None req-a1eb6d1f-002a-4e0d-95ba-353a623b9d7b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 15 15:19:31.480152 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-a1eb6d1f-002a-4e0d-95ba-353a623b9d7b admin admin] Request method failure captured: Jul 15 15:19:31.480152 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 15 15:19:31.480152 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: Accept: application/json Jul 15 15:19:31.480152 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: Accept-Encoding: gzip, deflate Jul 15 15:19:31.480152 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: Connection: keep-alive Jul 15 15:19:31.480152 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: Content-Length: 0 Jul 15 15:19:31.480152 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: Host: 10.222.0.40 Jul 15 15:19:31.480152 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: Openstack-Api-Version: compute 2.90 Jul 15 15:19:31.480152 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: Openstack-System-Scope: None Jul 15 15:19:31.480152 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: User-Agent: python-novaclient Jul 15 15:19:31.480152 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Auth-Token: gAAAAABi0YWCM5MM1TbucvrC4awmKrDzSnJVIXTdywFkqQ5lIlcAzSzbpGDL2A9DY8FHVhyPasLXXZNGZjZKuWtwlf5hQ8As6yz7iA9HcPoCs5KXAToyZJTYp6WebYnsDvegpgVIFHnwR1yrnERJJTY8tGO5ARe86Lzzi7IW8tRMGRI1bSyKBqI Jul 15 15:19:31.480152 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Domain-Id: None Jul 15 15:19:31.480152 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Domain-Name: None Jul 15 15:19:31.480152 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Identity-Status: Confirmed Jul 15 15:19:31.480152 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Is-Admin-Project: True Jul 15 15:19:31.480152 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 15:19:31.480152 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Project-Domain-Id: default Jul 15 15:19:31.480152 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Project-Domain-Name: Default Jul 15 15:19:31.480152 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Project-Id: 7405d44ad14342729b633b56109fe767 Jul 15 15:19:31.480152 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Project-Name: admin Jul 15 15:19:31.480152 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Role: admin,member,reader Jul 15 15:19:31.480152 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Roles: admin,member,reader Jul 15 15:19:31.481761 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7405d44ad14342729b633b56109fe767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7405d44ad14342729b633b56109fe767", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7405d44ad14342729b633b56109fe767"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7405d44ad14342729b633b56109fe767"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:19:31.481761 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Tenant: admin Jul 15 15:19:31.481761 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Tenant-Id: 7405d44ad14342729b633b56109fe767 Jul 15 15:19:31.481761 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Tenant-Name: admin Jul 15 15:19:31.481761 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-User: admin Jul 15 15:19:31.481761 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-User-Domain-Id: default Jul 15 15:19:31.481761 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-User-Domain-Name: Default Jul 15 15:19:31.481761 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-User-Id: 1b155a91a9264755b87c158c22553253 Jul 15 15:19:31.481761 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-User-Name: admin Jul 15 15:19:31.481761 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: method: > Jul 15 15:19:31.481761 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: exception: Flavor 42 could not be found. Jul 15 15:19:31.481761 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: action_args: {'id': '42'} Jul 15 15:19:31.481761 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:19:31.481761 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:19:31.483402 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 15:19:31.483402 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 15:19:31.483402 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 15:19:31.483402 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 15:19:31.483402 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 15:19:31.483402 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 15:19:31.483402 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 15:19:31.483402 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 15:19:31.483402 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 15:19:31.483402 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:19:31.483402 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 15:19:31.483402 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 15:19:31.483402 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 15 15:19:31.483402 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 15 15:19:31.483402 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:19:31.483402 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 15 15:19:31.483402 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:19:31.483402 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:19:31.483402 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:19:31.485795 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:19:31.485795 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:19:31.485795 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:19:31.485795 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:19:31.485795 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 15:19:31.485795 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:19:31.485795 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 15 15:19:31.485795 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 15 15:19:31.485795 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:19:31.485795 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 15 15:19:31.485795 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:19:31.485795 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:19:31.485795 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:19:31.485795 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:19:31.485795 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:19:31.485795 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 15 15:19:31.485795 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 15 15:19:31.485795 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-a1eb6d1f-002a-4e0d-95ba-353a623b9d7b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:19:31.488138 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-a1eb6d1f-002a-4e0d-95ba-353a623b9d7b admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.461468 Jul 15 15:19:31.488138 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 19/39] 10.222.0.40 () {60 vars in 1190 bytes} [Fri Jul 15 15:19:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 463 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 15 15:19:31.497320 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-74c88a16-b2cc-486f-b117-0579931ab77c admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:19:31.502001 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:19:31.524995 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-74c88a16-b2cc-486f-b117-0579931ab77c admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.034020 Jul 15 15:19:31.525573 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 21/40] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Jul 15 15:19:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:19:31.535567 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-387fb534-65a0-473a-a990-278e6519898b admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:19:31.557840 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-387fb534-65a0-473a-a990-278e6519898b admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025934 Jul 15 15:19:31.558398 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 20/41] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Jul 15 15:19:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:19:31.571272 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-c904e0ae-c0e6-44eb-828c-75447067d56a admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:19:31.578536 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.wsgi [None req-c904e0ae-c0e6-44eb-828c-75447067d56a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 15 15:19:31.582334 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-c904e0ae-c0e6-44eb-828c-75447067d56a admin admin] Request method failure captured: Jul 15 15:19:31.582334 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 15 15:19:31.582334 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: Accept: application/json Jul 15 15:19:31.582334 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: Accept-Encoding: gzip, deflate Jul 15 15:19:31.582334 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: Connection: keep-alive Jul 15 15:19:31.582334 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: Content-Length: 0 Jul 15 15:19:31.582334 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: Host: 10.222.0.40 Jul 15 15:19:31.582334 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: Openstack-Api-Version: compute 2.90 Jul 15 15:19:31.582334 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: Openstack-System-Scope: None Jul 15 15:19:31.582334 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: User-Agent: python-novaclient Jul 15 15:19:31.582334 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Auth-Token: gAAAAABi0YWCM5MM1TbucvrC4awmKrDzSnJVIXTdywFkqQ5lIlcAzSzbpGDL2A9DY8FHVhyPasLXXZNGZjZKuWtwlf5hQ8As6yz7iA9HcPoCs5KXAToyZJTYp6WebYnsDvegpgVIFHnwR1yrnERJJTY8tGO5ARe86Lzzi7IW8tRMGRI1bSyKBqI Jul 15 15:19:31.582334 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Domain-Id: None Jul 15 15:19:31.582334 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Domain-Name: None Jul 15 15:19:31.582334 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Identity-Status: Confirmed Jul 15 15:19:31.582334 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Is-Admin-Project: True Jul 15 15:19:31.582334 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 15:19:31.582334 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Project-Domain-Id: default Jul 15 15:19:31.582334 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Project-Domain-Name: Default Jul 15 15:19:31.582334 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Project-Id: 7405d44ad14342729b633b56109fe767 Jul 15 15:19:31.582334 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Project-Name: admin Jul 15 15:19:31.582334 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Role: admin,member,reader Jul 15 15:19:31.582334 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Roles: admin,member,reader Jul 15 15:19:31.583895 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7405d44ad14342729b633b56109fe767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7405d44ad14342729b633b56109fe767", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7405d44ad14342729b633b56109fe767"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7405d44ad14342729b633b56109fe767"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:19:31.583895 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Tenant: admin Jul 15 15:19:31.583895 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Tenant-Id: 7405d44ad14342729b633b56109fe767 Jul 15 15:19:31.583895 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Tenant-Name: admin Jul 15 15:19:31.583895 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-User: admin Jul 15 15:19:31.583895 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-User-Domain-Id: default Jul 15 15:19:31.583895 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-User-Domain-Name: Default Jul 15 15:19:31.583895 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-User-Id: 1b155a91a9264755b87c158c22553253 Jul 15 15:19:31.583895 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-User-Name: admin Jul 15 15:19:31.583895 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: method: > Jul 15 15:19:31.583895 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: exception: Flavor 42 could not be found. Jul 15 15:19:31.583895 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: action_args: {'id': '42'} Jul 15 15:19:31.583895 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:19:31.583895 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:19:31.585082 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 15:19:31.585082 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 15:19:31.585082 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 15:19:31.585082 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 15:19:31.585082 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 15:19:31.585082 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 15:19:31.585082 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 15:19:31.585082 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 15:19:31.585082 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 15:19:31.585082 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:19:31.585082 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 15:19:31.585082 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 15:19:31.585082 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 15 15:19:31.585082 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 15 15:19:31.585082 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:19:31.585082 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 15 15:19:31.585082 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:19:31.585082 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:19:31.585082 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:19:31.586585 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:19:31.586585 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:19:31.586585 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:19:31.586585 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:19:31.586585 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 15:19:31.586585 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:19:31.586585 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 15 15:19:31.586585 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 15 15:19:31.586585 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:19:31.586585 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 15 15:19:31.586585 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:19:31.586585 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:19:31.586585 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:19:31.586585 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:19:31.586585 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:19:31.586585 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 15 15:19:31.586585 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 15 15:19:31.586585 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-c904e0ae-c0e6-44eb-828c-75447067d56a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:19:31.587962 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-c904e0ae-c0e6-44eb-828c-75447067d56a admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.018675 Jul 15 15:19:31.587962 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 22/42] 10.222.0.40 () {60 vars in 1190 bytes} [Fri Jul 15 15:19:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 15 15:19:32.576181 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-387fb534-65a0-473a-a990-278e6519898b admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:19:32.578198 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-387fb534-65a0-473a-a990-278e6519898b admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002312 Jul 15 15:19:32.578935 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 21/43] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Jul 15 15:19:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:19:33.146098 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-76a01680-15d6-4ca3-ba4c-262ca80bc7dc admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:19:33.154327 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.wsgi [None req-76a01680-15d6-4ca3-ba4c-262ca80bc7dc admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 15 15:19:33.156716 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-76a01680-15d6-4ca3-ba4c-262ca80bc7dc admin admin] Request method failure captured: Jul 15 15:19:33.156716 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 15 15:19:33.156716 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: Accept: application/json Jul 15 15:19:33.156716 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: Accept-Encoding: gzip, deflate Jul 15 15:19:33.156716 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: Connection: keep-alive Jul 15 15:19:33.156716 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: Content-Length: 0 Jul 15 15:19:33.156716 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: Host: 10.222.0.40 Jul 15 15:19:33.156716 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: Openstack-Api-Version: compute 2.90 Jul 15 15:19:33.156716 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: Openstack-System-Scope: None Jul 15 15:19:33.156716 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: User-Agent: python-novaclient Jul 15 15:19:33.156716 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Auth-Token: gAAAAABi0YWEr8bPXV3vdcflmFl0UBRDm-_yNK2vvv5P8GpsrbXoyplLHAv7pfqwmnP1n4LBlK6ekSv-omki9JxKCBOMtZFQ_Sz5dqQJjakwiv3scCVbuzvtwNEUxIwau13P2E0aSfralSJPLBlr0DtxgeuH8-94rH8QaT6DZT5dlIiEy3Fk4hs Jul 15 15:19:33.156716 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Domain-Id: None Jul 15 15:19:33.156716 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Domain-Name: None Jul 15 15:19:33.156716 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Identity-Status: Confirmed Jul 15 15:19:33.156716 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Is-Admin-Project: True Jul 15 15:19:33.156716 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 15:19:33.156716 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Project-Domain-Id: default Jul 15 15:19:33.156716 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Project-Domain-Name: Default Jul 15 15:19:33.156716 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Project-Id: 7405d44ad14342729b633b56109fe767 Jul 15 15:19:33.156716 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Project-Name: admin Jul 15 15:19:33.156716 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Role: admin,member,reader Jul 15 15:19:33.156716 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Roles: admin,member,reader Jul 15 15:19:33.158961 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7405d44ad14342729b633b56109fe767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7405d44ad14342729b633b56109fe767", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7405d44ad14342729b633b56109fe767"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7405d44ad14342729b633b56109fe767"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:19:33.158961 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Tenant: admin Jul 15 15:19:33.158961 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Tenant-Id: 7405d44ad14342729b633b56109fe767 Jul 15 15:19:33.158961 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Tenant-Name: admin Jul 15 15:19:33.158961 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-User: admin Jul 15 15:19:33.158961 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-User-Domain-Id: default Jul 15 15:19:33.158961 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-User-Domain-Name: Default Jul 15 15:19:33.158961 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-User-Id: 1b155a91a9264755b87c158c22553253 Jul 15 15:19:33.158961 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-User-Name: admin Jul 15 15:19:33.158961 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: method: > Jul 15 15:19:33.158961 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: exception: Flavor 84 could not be found. Jul 15 15:19:33.158961 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: action_args: {'id': '84'} Jul 15 15:19:33.158961 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:19:33.158961 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:19:33.160363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 15:19:33.160363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 15:19:33.160363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 15:19:33.160363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 15:19:33.160363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 15:19:33.160363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 15:19:33.160363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 15:19:33.160363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 15:19:33.160363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 15:19:33.160363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:19:33.160363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 15:19:33.160363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 15:19:33.160363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 15 15:19:33.160363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 15 15:19:33.160363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:19:33.160363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 15 15:19:33.160363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:19:33.160363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:19:33.160363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:19:33.162069 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:19:33.162069 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:19:33.162069 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:19:33.162069 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:19:33.162069 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 15:19:33.162069 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:19:33.162069 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 15 15:19:33.162069 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 15 15:19:33.162069 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:19:33.162069 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 15 15:19:33.162069 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:19:33.162069 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:19:33.162069 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:19:33.162069 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:19:33.162069 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:19:33.162069 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 15 15:19:33.162069 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 15 15:19:33.162069 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-76a01680-15d6-4ca3-ba4c-262ca80bc7dc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:19:33.163602 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-76a01680-15d6-4ca3-ba4c-262ca80bc7dc admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.438673 Jul 15 15:19:33.163602 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1190 bytes} [Fri Jul 15 15:19:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 440 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 15 15:19:33.169654 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-52c908e5-115d-418f-aab2-ba84eeffb6f4 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:19:33.184061 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-52c908e5-115d-418f-aab2-ba84eeffb6f4 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018054 Jul 15 15:19:33.184630 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 22/45] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Jul 15 15:19:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:19:33.195030 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-7f2b32a7-b131-4441-a09d-3c22bd6ee530 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:19:33.210574 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-7f2b32a7-b131-4441-a09d-3c22bd6ee530 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019703 Jul 15 15:19:33.211164 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Jul 15 15:19:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:19:33.221676 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-88ab20ca-17cc-4168-b40f-77ef97ebdba0 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:19:33.227952 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.wsgi [None req-88ab20ca-17cc-4168-b40f-77ef97ebdba0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 15 15:19:33.229492 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-88ab20ca-17cc-4168-b40f-77ef97ebdba0 admin admin] Request method failure captured: Jul 15 15:19:33.229492 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 15 15:19:33.229492 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: Accept: application/json Jul 15 15:19:33.229492 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: Accept-Encoding: gzip, deflate Jul 15 15:19:33.229492 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: Connection: keep-alive Jul 15 15:19:33.229492 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: Content-Length: 0 Jul 15 15:19:33.229492 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: Host: 10.222.0.40 Jul 15 15:19:33.229492 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: Openstack-Api-Version: compute 2.90 Jul 15 15:19:33.229492 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: Openstack-System-Scope: None Jul 15 15:19:33.229492 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: User-Agent: python-novaclient Jul 15 15:19:33.229492 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Auth-Token: gAAAAABi0YWEr8bPXV3vdcflmFl0UBRDm-_yNK2vvv5P8GpsrbXoyplLHAv7pfqwmnP1n4LBlK6ekSv-omki9JxKCBOMtZFQ_Sz5dqQJjakwiv3scCVbuzvtwNEUxIwau13P2E0aSfralSJPLBlr0DtxgeuH8-94rH8QaT6DZT5dlIiEy3Fk4hs Jul 15 15:19:33.229492 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Domain-Id: None Jul 15 15:19:33.229492 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Domain-Name: None Jul 15 15:19:33.229492 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Identity-Status: Confirmed Jul 15 15:19:33.229492 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Is-Admin-Project: True Jul 15 15:19:33.229492 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 15:19:33.229492 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Project-Domain-Id: default Jul 15 15:19:33.229492 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Project-Domain-Name: Default Jul 15 15:19:33.229492 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Project-Id: 7405d44ad14342729b633b56109fe767 Jul 15 15:19:33.229492 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Project-Name: admin Jul 15 15:19:33.229492 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Role: admin,member,reader Jul 15 15:19:33.229492 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Roles: admin,member,reader Jul 15 15:19:33.236184 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7405d44ad14342729b633b56109fe767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7405d44ad14342729b633b56109fe767", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7405d44ad14342729b633b56109fe767"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7405d44ad14342729b633b56109fe767"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:19:33.236184 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Tenant: admin Jul 15 15:19:33.236184 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Tenant-Id: 7405d44ad14342729b633b56109fe767 Jul 15 15:19:33.236184 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Tenant-Name: admin Jul 15 15:19:33.236184 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-User: admin Jul 15 15:19:33.236184 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-User-Domain-Id: default Jul 15 15:19:33.236184 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-User-Domain-Name: Default Jul 15 15:19:33.236184 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-User-Id: 1b155a91a9264755b87c158c22553253 Jul 15 15:19:33.236184 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-User-Name: admin Jul 15 15:19:33.236184 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: method: > Jul 15 15:19:33.236184 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: exception: Flavor 84 could not be found. Jul 15 15:19:33.236184 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: action_args: {'id': '84'} Jul 15 15:19:33.236184 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:19:33.236184 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:19:33.237253 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 15:19:33.237253 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 15:19:33.237253 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 15:19:33.237253 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 15:19:33.237253 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 15:19:33.237253 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 15:19:33.237253 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 15:19:33.237253 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 15:19:33.237253 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 15:19:33.237253 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:19:33.237253 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 15:19:33.237253 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 15:19:33.237253 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 15 15:19:33.237253 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 15 15:19:33.237253 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:19:33.237253 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 15 15:19:33.237253 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:19:33.237253 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:19:33.237253 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:19:33.238659 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:19:33.238659 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:19:33.238659 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:19:33.238659 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:19:33.238659 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 15:19:33.238659 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:19:33.238659 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 15 15:19:33.238659 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 15 15:19:33.238659 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:19:33.238659 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 15 15:19:33.238659 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:19:33.238659 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:19:33.238659 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:19:33.238659 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:19:33.238659 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:19:33.238659 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 15 15:19:33.238659 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 15 15:19:33.238659 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-88ab20ca-17cc-4168-b40f-77ef97ebdba0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:19:33.240122 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-88ab20ca-17cc-4168-b40f-77ef97ebdba0 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013121 Jul 15 15:19:33.240122 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 23/47] 10.222.0.40 () {60 vars in 1190 bytes} [Fri Jul 15 15:19:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 15 15:19:34.209388 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-7f2b32a7-b131-4441-a09d-3c22bd6ee530 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:19:34.210386 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-7f2b32a7-b131-4441-a09d-3c22bd6ee530 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001716 Jul 15 15:19:34.210776 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 25/48] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Jul 15 15:19:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:19:34.786237 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-9a10a186-eb6f-403e-9f87-65ae08c7dea3 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:19:34.792156 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.wsgi [None req-9a10a186-eb6f-403e-9f87-65ae08c7dea3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 15 15:19:34.793633 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-9a10a186-eb6f-403e-9f87-65ae08c7dea3 admin admin] Request method failure captured: Jul 15 15:19:34.793633 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 15 15:19:34.793633 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: Accept: application/json Jul 15 15:19:34.793633 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: Accept-Encoding: gzip, deflate Jul 15 15:19:34.793633 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: Connection: keep-alive Jul 15 15:19:34.793633 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: Content-Length: 0 Jul 15 15:19:34.793633 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: Host: 10.222.0.40 Jul 15 15:19:34.793633 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: Openstack-Api-Version: compute 2.90 Jul 15 15:19:34.793633 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: Openstack-System-Scope: None Jul 15 15:19:34.793633 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: User-Agent: python-novaclient Jul 15 15:19:34.793633 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Auth-Token: gAAAAABi0YWGHZhSnDMEhA_Z6lfcPYhqCW0P8Hd4W3kNHilSkrb5ZWMZz2vgFsAUjplXlQikGQ0RYBrPMZpaffY9mBi0mUx29kK-BcdLYAktEduQUi81tWLMIU214RTwtQjwQOfM1IdPG9j_RG1VeM7lxclsIP1CzWPBhnLYGl8_njBfgjTTbZU Jul 15 15:19:34.793633 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Domain-Id: None Jul 15 15:19:34.793633 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Domain-Name: None Jul 15 15:19:34.793633 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Identity-Status: Confirmed Jul 15 15:19:34.793633 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Is-Admin-Project: True Jul 15 15:19:34.793633 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 15:19:34.793633 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Project-Domain-Id: default Jul 15 15:19:34.793633 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Project-Domain-Name: Default Jul 15 15:19:34.793633 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Project-Id: 7405d44ad14342729b633b56109fe767 Jul 15 15:19:34.793633 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Project-Name: admin Jul 15 15:19:34.793633 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Role: admin,member,reader Jul 15 15:19:34.793633 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Roles: admin,member,reader Jul 15 15:19:34.795372 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7405d44ad14342729b633b56109fe767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7405d44ad14342729b633b56109fe767", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7405d44ad14342729b633b56109fe767"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7405d44ad14342729b633b56109fe767"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:19:34.795372 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Tenant: admin Jul 15 15:19:34.795372 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Tenant-Id: 7405d44ad14342729b633b56109fe767 Jul 15 15:19:34.795372 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-Tenant-Name: admin Jul 15 15:19:34.795372 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-User: admin Jul 15 15:19:34.795372 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-User-Domain-Id: default Jul 15 15:19:34.795372 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-User-Domain-Name: Default Jul 15 15:19:34.795372 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-User-Id: 1b155a91a9264755b87c158c22553253 Jul 15 15:19:34.795372 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: X-User-Name: admin Jul 15 15:19:34.795372 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: method: > Jul 15 15:19:34.795372 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: exception: Flavor 451 could not be found. Jul 15 15:19:34.795372 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: action_args: {'id': '451'} Jul 15 15:19:34.795372 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:19:34.795372 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:19:34.796299 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 15:19:34.796299 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 15:19:34.796299 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 15:19:34.796299 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 15:19:34.796299 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 15:19:34.796299 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 15:19:34.796299 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 15:19:34.796299 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 15:19:34.796299 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 15:19:34.796299 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:19:34.796299 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 15:19:34.796299 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 15:19:34.796299 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 15 15:19:34.796299 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 15 15:19:34.796299 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:19:34.796299 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 15 15:19:34.796299 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:19:34.796299 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:19:34.796299 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:19:34.797628 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:19:34.797628 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:19:34.797628 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:19:34.797628 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:19:34.797628 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 15:19:34.797628 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:19:34.797628 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 15 15:19:34.797628 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 15 15:19:34.797628 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:19:34.797628 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 15 15:19:34.797628 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:19:34.797628 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:19:34.797628 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:19:34.797628 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:19:34.797628 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:19:34.797628 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 15 15:19:34.797628 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 15 15:19:34.797628 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-9a10a186-eb6f-403e-9f87-65ae08c7dea3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:19:34.798904 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-9a10a186-eb6f-403e-9f87-65ae08c7dea3 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.449229 Jul 15 15:19:34.798904 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 24/49] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Jul 15 15:19:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 451 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 15 15:19:34.805326 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-86fdfec6-38bf-479e-bd46-6e7dce31ee4f admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:19:34.819572 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-86fdfec6-38bf-479e-bd46-6e7dce31ee4f admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018145 Jul 15 15:19:34.820098 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 26/50] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Jul 15 15:19:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:19:34.830130 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-61d11c42-200e-4363-a860-18c4b05012ae admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:19:34.846151 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-61d11c42-200e-4363-a860-18c4b05012ae admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019875 Jul 15 15:19:34.846703 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 25/51] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Jul 15 15:19:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:19:34.861777 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-525d0bd5-da04-4ac3-9ef0-6b4ac4643ee8 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:19:34.868857 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.wsgi [None req-525d0bd5-da04-4ac3-9ef0-6b4ac4643ee8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 15 15:19:34.870363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-525d0bd5-da04-4ac3-9ef0-6b4ac4643ee8 admin admin] Request method failure captured: Jul 15 15:19:34.870363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 15 15:19:34.870363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: Accept: application/json Jul 15 15:19:34.870363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: Accept-Encoding: gzip, deflate Jul 15 15:19:34.870363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: Connection: keep-alive Jul 15 15:19:34.870363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: Content-Length: 0 Jul 15 15:19:34.870363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: Host: 10.222.0.40 Jul 15 15:19:34.870363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: Openstack-Api-Version: compute 2.90 Jul 15 15:19:34.870363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: Openstack-System-Scope: None Jul 15 15:19:34.870363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: User-Agent: python-novaclient Jul 15 15:19:34.870363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Auth-Token: gAAAAABi0YWGHZhSnDMEhA_Z6lfcPYhqCW0P8Hd4W3kNHilSkrb5ZWMZz2vgFsAUjplXlQikGQ0RYBrPMZpaffY9mBi0mUx29kK-BcdLYAktEduQUi81tWLMIU214RTwtQjwQOfM1IdPG9j_RG1VeM7lxclsIP1CzWPBhnLYGl8_njBfgjTTbZU Jul 15 15:19:34.870363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Domain-Id: None Jul 15 15:19:34.870363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Domain-Name: None Jul 15 15:19:34.870363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Identity-Status: Confirmed Jul 15 15:19:34.870363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Is-Admin-Project: True Jul 15 15:19:34.870363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 15:19:34.870363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Project-Domain-Id: default Jul 15 15:19:34.870363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Project-Domain-Name: Default Jul 15 15:19:34.870363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Project-Id: 7405d44ad14342729b633b56109fe767 Jul 15 15:19:34.870363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Project-Name: admin Jul 15 15:19:34.870363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Role: admin,member,reader Jul 15 15:19:34.870363 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Roles: admin,member,reader Jul 15 15:19:34.871775 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7405d44ad14342729b633b56109fe767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7405d44ad14342729b633b56109fe767", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7405d44ad14342729b633b56109fe767"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7405d44ad14342729b633b56109fe767"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:19:34.871775 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Tenant: admin Jul 15 15:19:34.871775 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Tenant-Id: 7405d44ad14342729b633b56109fe767 Jul 15 15:19:34.871775 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-Tenant-Name: admin Jul 15 15:19:34.871775 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-User: admin Jul 15 15:19:34.871775 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-User-Domain-Id: default Jul 15 15:19:34.871775 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-User-Domain-Name: Default Jul 15 15:19:34.871775 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-User-Id: 1b155a91a9264755b87c158c22553253 Jul 15 15:19:34.871775 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: X-User-Name: admin Jul 15 15:19:34.871775 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: method: > Jul 15 15:19:34.871775 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: exception: Flavor 451 could not be found. Jul 15 15:19:34.871775 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: action_args: {'id': '451'} Jul 15 15:19:34.871775 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:19:34.871775 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:19:34.872566 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 15:19:34.872566 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 15:19:34.872566 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 15:19:34.872566 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 15:19:34.872566 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 15:19:34.872566 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 15:19:34.872566 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 15:19:34.872566 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 15:19:34.872566 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 15:19:34.872566 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:19:34.872566 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 15:19:34.872566 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 15:19:34.872566 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 15 15:19:34.872566 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 15 15:19:34.872566 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:19:34.872566 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 15 15:19:34.872566 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:19:34.872566 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:19:34.872566 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:19:34.873715 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:19:34.873715 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:19:34.873715 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:19:34.873715 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:19:34.873715 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 15:19:34.873715 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:19:34.873715 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 15 15:19:34.873715 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 15 15:19:34.873715 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:19:34.873715 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 15 15:19:34.873715 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:19:34.873715 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:19:34.873715 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:19:34.873715 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:19:34.873715 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:19:34.873715 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 15 15:19:34.873715 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 15 15:19:34.873715 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-525d0bd5-da04-4ac3-9ef0-6b4ac4643ee8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:19:34.874765 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-525d0bd5-da04-4ac3-9ef0-6b4ac4643ee8 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.015874 Jul 15 15:19:34.874765 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 27/52] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Jul 15 15:19:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 15 15:19:35.971424 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-61d11c42-200e-4363-a860-18c4b05012ae admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:19:35.972431 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-61d11c42-200e-4363-a860-18c4b05012ae admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jul 15 15:19:35.972849 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 26/53] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Jul 15 15:19:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:19:36.548682 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-f4831899-c6c6-42b8-a16d-cab146637aed admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:19:36.571038 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-f4831899-c6c6-42b8-a16d-cab146637aed admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.460886 Jul 15 15:19:36.571643 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 28/54] 10.222.0.40 () {64 vars in 1235 bytes} [Fri Jul 15 15:19:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:19:37.580401 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-61d11c42-200e-4363-a860-18c4b05012ae admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:19:37.581543 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-61d11c42-200e-4363-a860-18c4b05012ae admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jul 15 15:19:37.581884 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 27/55] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Jul 15 15:19:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:19:38.142495 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-a82a680b-7ad7-4fa9-b177-5371d57b9ea1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:19:38.164394 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-a82a680b-7ad7-4fa9-b177-5371d57b9ea1 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.442426 Jul 15 15:19:38.164937 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 29/56] 10.222.0.40 () {64 vars in 1235 bytes} [Fri Jul 15 15:19:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:19:39.186566 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-61d11c42-200e-4363-a860-18c4b05012ae admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:19:39.187640 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-61d11c42-200e-4363-a860-18c4b05012ae admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jul 15 15:19:39.188026 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 28/57] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Jul 15 15:19:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:19:39.769414 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-c780c0be-237b-4f4e-9f3a-7ff8d7e293d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:19:39.793657 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-c780c0be-237b-4f4e-9f3a-7ff8d7e293d9 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.466111 Jul 15 15:19:39.794206 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 30/58] 10.222.0.40 () {64 vars in 1235 bytes} [Fri Jul 15 15:19:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:19:40.797142 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-61d11c42-200e-4363-a860-18c4b05012ae admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:19:40.798154 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-61d11c42-200e-4363-a860-18c4b05012ae admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 15 15:19:40.798552 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 29/59] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Jul 15 15:19:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:19:41.359045 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-aaa6333c-c31f-43d6-b853-a9f42ffca8cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:19:41.380386 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-aaa6333c-c31f-43d6-b853-a9f42ffca8cd admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.443387 Jul 15 15:19:41.381189 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 31/60] 10.222.0.40 () {64 vars in 1235 bytes} [Fri Jul 15 15:19:40 2022] POST /compute/v2.1/flavors => generated 409 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:19:42.380395 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-61d11c42-200e-4363-a860-18c4b05012ae admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:19:42.381440 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-61d11c42-200e-4363-a860-18c4b05012ae admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 Jul 15 15:19:42.381827 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 30/61] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Jul 15 15:19:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:19:42.932495 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-1f656abc-9bd2-4456-b7d7-689f8c3fab1b admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:19:42.952593 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-1f656abc-9bd2-4456-b7d7-689f8c3fab1b admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.435330 Jul 15 15:19:42.953137 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 32/62] 10.222.0.40 () {60 vars in 1202 bytes} [Fri Jul 15 15:19:42 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:20:35.523850 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-61d11c42-200e-4363-a860-18c4b05012ae admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:20:35.525176 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-61d11c42-200e-4363-a860-18c4b05012ae admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001875 Jul 15 15:20:35.525717 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 31/63] 10.222.0.40 () {54 vars in 930 bytes} [Fri Jul 15 15:20:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:20:35.543146 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:20:35.946887 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-fe62e82d-a586-4dae-a6ad-14fe8b1b0ccc admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:20:35.967524 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-fe62e82d-a586-4dae-a6ad-14fe8b1b0ccc admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.431571 Jul 15 15:20:35.968073 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 33/64] 10.222.0.40 () {60 vars in 1291 bytes} [Fri Jul 15 15:20:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:20:35.989332 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:20:35.993312 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-9048de49-de93-4e3a-b6c2-3d5f34440214 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:20:36.001908 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-9048de49-de93-4e3a-b6c2-3d5f34440214 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014050 Jul 15 15:20:36.002429 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 32/65] 10.222.0.40 () {60 vars in 1282 bytes} [Fri Jul 15 15:20:35 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:20:36.020575 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-b38eb4fb-a308-474b-bb83-79449fd8d070 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:20:36.031476 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-b38eb4fb-a308-474b-bb83-79449fd8d070 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016918 Jul 15 15:20:36.031992 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 34/66] 10.222.0.40 () {60 vars in 1285 bytes} [Fri Jul 15 15:20:36 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:20:36.046600 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-e5ef15a4-583f-4565-b935-159c30802cd6 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:20:36.058590 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-e5ef15a4-583f-4565-b935-159c30802cd6 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.018017 Jul 15 15:20:36.059292 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 33/67] 10.222.0.40 () {60 vars in 1285 bytes} [Fri Jul 15 15:20:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:20:36.071099 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-6cd5b4c1-a980-4685-a878-9d4777cff07d admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:20:36.079100 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-6cd5b4c1-a980-4685-a878-9d4777cff07d admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011813 Jul 15 15:20:36.079613 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 35/68] 10.222.0.40 () {60 vars in 1282 bytes} [Fri Jul 15 15:20:36 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:24:07.723104 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-e5ef15a4-583f-4565-b935-159c30802cd6 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:24:07.725021 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-e5ef15a4-583f-4565-b935-159c30802cd6 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002625 Jul 15 15:24:07.725428 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 34/69] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Jul 15 15:24:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:24:07.873016 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_api:SELECT=6 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:24:08.049412 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-fe0b6cf3-ca41-4cfd-9d29-55a56b2e86c3 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:24:08.051561 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:24:08.051561 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: warnings.warn(msg) Jul 15 15:24:08.053556 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-fe0b6cf3-ca41-4cfd-9d29-55a56b2e86c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:24:08.054270 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-fe0b6cf3-ca41-4cfd-9d29-55a56b2e86c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:24:08.055371 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-fe0b6cf3-ca41-4cfd-9d29-55a56b2e86c3 admin admin] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:24:08.055846 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-fe0b6cf3-ca41-4cfd-9d29-55a56b2e86c3 admin admin] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:24:08.093862 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-fe0b6cf3-ca41-4cfd-9d29-55a56b2e86c3 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.223545 Jul 15 15:24:08.094496 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 36/70] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Jul 15 15:24:07 2022] GET /compute/v2.1/os-services => generated 791 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:24:08.928658 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-e5ef15a4-583f-4565-b935-159c30802cd6 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:24:08.930116 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-e5ef15a4-583f-4565-b935-159c30802cd6 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jul 15 15:24:08.930512 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 35/71] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Jul 15 15:24:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:24:09.146831 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-be2b330a-12ac-47c1-9217-e699f51996d6 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:24:09.147994 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:24:09.147994 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: warnings.warn(msg) Jul 15 15:24:09.149529 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-be2b330a-12ac-47c1-9217-e699f51996d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:24:09.150066 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-be2b330a-12ac-47c1-9217-e699f51996d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:24:09.151139 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-be2b330a-12ac-47c1-9217-e699f51996d6 admin admin] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:24:09.151837 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-be2b330a-12ac-47c1-9217-e699f51996d6 admin admin] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:24:09.174108 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-be2b330a-12ac-47c1-9217-e699f51996d6 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.098578 Jul 15 15:24:09.174564 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 37/72] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Jul 15 15:24:09 2022] GET /compute/v2.1/os-services => generated 791 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:24:20.467410 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-e5ef15a4-583f-4565-b935-159c30802cd6 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:24:20.468390 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-e5ef15a4-583f-4565-b935-159c30802cd6 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 15 15:24:20.468774 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 36/73] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Jul 15 15:24:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:24:20.614845 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_cell0:SELECT=4 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:24:20.615700 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_cell1:SELECT=4 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:24:20.616339 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_api:SELECT=8 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:24:20.680805 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-ecef51cf-402f-4ea8-a392-160eeb41b7b8 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:24:20.682050 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:24:20.682050 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: warnings.warn(msg) Jul 15 15:24:20.683443 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-ecef51cf-402f-4ea8-a392-160eeb41b7b8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:24:20.683923 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-ecef51cf-402f-4ea8-a392-160eeb41b7b8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:24:20.684767 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-ecef51cf-402f-4ea8-a392-160eeb41b7b8 admin admin] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:24:20.685234 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-ecef51cf-402f-4ea8-a392-160eeb41b7b8 admin admin] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:24:20.712907 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-ecef51cf-402f-4ea8-a392-160eeb41b7b8 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.103571 Jul 15 15:24:20.713496 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 38/74] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Jul 15 15:24:20 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:24:21.559565 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-e5ef15a4-583f-4565-b935-159c30802cd6 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:24:21.560696 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-e5ef15a4-583f-4565-b935-159c30802cd6 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001887 Jul 15 15:24:21.561086 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 37/75] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Jul 15 15:24:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:24:21.770295 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-3f6183c2-2177-455f-b788-f7874ab6844d admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:24:21.771501 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:24:21.771501 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: warnings.warn(msg) Jul 15 15:24:21.772683 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-3f6183c2-2177-455f-b788-f7874ab6844d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:24:21.773123 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-3f6183c2-2177-455f-b788-f7874ab6844d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:24:21.773896 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-3f6183c2-2177-455f-b788-f7874ab6844d admin admin] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:24:21.774322 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-3f6183c2-2177-455f-b788-f7874ab6844d admin admin] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:24:21.796491 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-3f6183c2-2177-455f-b788-f7874ab6844d admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.091305 Jul 15 15:24:21.797034 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 39/76] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Jul 15 15:24:21 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:25:20.704525 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: Fri Jul 15 15:25:20 2022 - graceful shutdown triggered... Jul 15 15:25:20.705218 dv-cinder-850015-1-iscsi devstack@n-api.service[103271]: Gracefully killing worker 1 (pid: 103271)... Jul 15 15:25:20.705345 dv-cinder-850015-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 15 15:25:20.706184 dv-cinder-850015-1-iscsi devstack@n-api.service[103272]: Gracefully killing worker 2 (pid: 103272)... Jul 15 15:25:21.706412 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: worker 1 buried after 1 seconds Jul 15 15:25:21.706412 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: worker 2 buried after 1 seconds Jul 15 15:25:21.706412 dv-cinder-850015-1-iscsi devstack@n-api.service[103270]: goodbye to uWSGI. Jul 15 15:25:21.708933 dv-cinder-850015-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 15 15:25:21.709831 dv-cinder-850015-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 15 15:25:21.714348 dv-cinder-850015-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 15 15:25:21.734105 dv-cinder-850015-1-iscsi devstack@n-api.service[117981]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 15 15:25:21.736263 dv-cinder-850015-1-iscsi devstack@n-api.service[117981]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 15 15:25:21 2022] *** Jul 15 15:25:21.736263 dv-cinder-850015-1-iscsi devstack@n-api.service[117981]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 15 15:25:21.736263 dv-cinder-850015-1-iscsi devstack@n-api.service[117981]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 15 15:25:21.736263 dv-cinder-850015-1-iscsi devstack@n-api.service[117981]: nodename: dv-cinder-850015-1-iscsi Jul 15 15:25:21.736263 dv-cinder-850015-1-iscsi devstack@n-api.service[117981]: machine: x86_64 Jul 15 15:25:21.736263 dv-cinder-850015-1-iscsi devstack@n-api.service[117981]: clock source: unix Jul 15 15:25:21.736263 dv-cinder-850015-1-iscsi devstack@n-api.service[117981]: pcre jit disabled Jul 15 15:25:21.736263 dv-cinder-850015-1-iscsi devstack@n-api.service[117981]: detected number of CPU cores: 4 Jul 15 15:25:21.736263 dv-cinder-850015-1-iscsi devstack@n-api.service[117981]: current working directory: / Jul 15 15:25:21.736263 dv-cinder-850015-1-iscsi devstack@n-api.service[117981]: detected binary path: /usr/bin/uwsgi-core Jul 15 15:25:21.736263 dv-cinder-850015-1-iscsi devstack@n-api.service[117981]: your processes number limit is 47680 Jul 15 15:25:21.737033 dv-cinder-850015-1-iscsi devstack@n-api.service[117981]: your memory page size is 4096 bytes Jul 15 15:25:21.737033 dv-cinder-850015-1-iscsi devstack@n-api.service[117981]: detected max file descriptor number: 2048 Jul 15 15:25:21.737033 dv-cinder-850015-1-iscsi devstack@n-api.service[117981]: lock engine: pthread robust mutexes Jul 15 15:25:21.737033 dv-cinder-850015-1-iscsi devstack@n-api.service[117981]: thunder lock: enabled Jul 15 15:25:21.737033 dv-cinder-850015-1-iscsi devstack@n-api.service[117981]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 15 15:25:21.737033 dv-cinder-850015-1-iscsi devstack@n-api.service[117981]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 15 15:25:21.778901 dv-cinder-850015-1-iscsi devstack@n-api.service[117981]: Python main interpreter initialized at 0x559551e299c0 Jul 15 15:25:21.778901 dv-cinder-850015-1-iscsi devstack@n-api.service[117981]: python threads support enabled Jul 15 15:25:21.778901 dv-cinder-850015-1-iscsi devstack@n-api.service[117981]: your server socket listen backlog is limited to 100 connections Jul 15 15:25:21.778901 dv-cinder-850015-1-iscsi devstack@n-api.service[117981]: your mercy for graceful operations on workers is 90 seconds Jul 15 15:25:21.779377 dv-cinder-850015-1-iscsi devstack@n-api.service[117981]: mapped 403077 bytes (393 KB) for 2 cores Jul 15 15:25:21.779377 dv-cinder-850015-1-iscsi devstack@n-api.service[117981]: *** Operational MODE: preforking *** Jul 15 15:25:21.779611 dv-cinder-850015-1-iscsi devstack@n-api.service[117981]: *** uWSGI is running in multiple interpreter mode *** Jul 15 15:25:21.779611 dv-cinder-850015-1-iscsi devstack@n-api.service[117981]: spawned uWSGI master process (pid: 117981) Jul 15 15:25:21.779850 dv-cinder-850015-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 15 15:25:21.780490 dv-cinder-850015-1-iscsi devstack@n-api.service[117981]: spawned uWSGI worker 1 (pid: 117998, cores: 1) Jul 15 15:25:21.781188 dv-cinder-850015-1-iscsi devstack@n-api.service[117981]: spawned uWSGI worker 2 (pid: 117999, cores: 1) Jul 15 15:25:21.781188 dv-cinder-850015-1-iscsi devstack@n-api.service[117981]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 15 15:25:22.432342 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 15 15:25:22.432970 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 15 15:25:23.580781 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 15:25:23.580781 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: from cryptography.utils import int_from_bytes Jul 15 15:25:23.581535 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 15:25:23.581535 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: from cryptography.utils import int_from_bytes Jul 15 15:25:23.594263 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 15:25:23.594263 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: from cryptography.utils import int_from_bytes Jul 15 15:25:23.594885 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 15:25:23.594885 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: from cryptography.utils import int_from_bytes Jul 15 15:25:25.874954 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 15:25:25.875666 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 15:25:25.875800 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 15:25:25.876155 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 15:25:25.876433 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 15:25:25.876761 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.877075 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.877393 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.877732 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.878058 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.878373 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.878716 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.879034 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.879371 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.879626 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.879939 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.880258 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850015-1-iscsi {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.880577 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.880885 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.881197 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.881521 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.881811 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.882158 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.882436 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.882970 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.884778 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.884778 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.884778 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.884778 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.884778 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.885269 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.885269 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.885704 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.885825 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.886126 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.886700 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850015-1-iscsi {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.887144 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.887361 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.887641 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.888068 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.888395 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.888708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.888985 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.889348 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.889620 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.889937 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.890252 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.890602 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.890942 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.891240 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.891538 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.892148 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.892148 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.892496 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.892724 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.892989 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.893281 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.893598 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.895042 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.895042 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.895042 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.895042 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.895751 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.896145 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.896484 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.896745 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.897092 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.897377 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.897682 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.897955 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.898260 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.898587 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.898944 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.899252 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.899575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.899912 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.900084 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 15:25:25.900553 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.900714 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 15:25:25.900957 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.901124 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 15:25:25.901291 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.901291 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.901581 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 15:25:25.901581 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 15:25:25.901891 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.901891 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.902190 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.902572 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.902748 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.902748 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.903116 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.903116 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.903488 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.903676 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.903676 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.903972 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.904139 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.904285 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.904427 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.904569 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.904710 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.905389 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.905563 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.905563 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.905850 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.905850 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.906364 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.906364 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.906794 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.906950 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.907121 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850015-1-iscsi {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.907376 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.907697 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.908149 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.908315 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.908469 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.908658 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.908753 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.908838 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.908968 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.909056 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.909187 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.909390 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.909489 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.909586 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.909685 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.909685 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.909862 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.909989 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.910084 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.910179 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.910266 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.910351 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.910441 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.910570 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.910659 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.910762 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.910865 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.910970 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.911064 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.911149 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.911239 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.911333 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.911430 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.911523 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.911640 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.911785 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.911957 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.912176 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.912400 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850015-1-iscsi {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.912556 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.912725 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.912877 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.912983 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.913070 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.913328 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.913483 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.913588 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.913760 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.913900 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.914047 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.914198 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.914382 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.914557 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.914701 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.914812 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.915048 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.915252 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.915403 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.915505 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.915661 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.915787 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.915974 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.916091 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.916282 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.916390 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.916584 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.916690 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.916882 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.916995 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.917180 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.917279 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.917483 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.917582 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.917837 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.918013 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.918150 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.918274 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.918431 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.918620 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.918778 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.918885 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.919025 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.919188 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.919351 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.919511 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.919720 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.919875 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.920025 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.920177 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.920324 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.920476 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.920626 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.920769 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.920925 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.921069 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.921216 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.921376 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.921524 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.921666 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.921825 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.921960 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.922111 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.922265 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.922404 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.922685 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.922780 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.922876 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.922971 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.923183 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.923282 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.923493 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.923584 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.923816 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.923926 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.924123 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.924223 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.924430 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.924529 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.924744 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.924848 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.925056 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.925221 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.925387 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.925486 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.925695 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.925811 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.926008 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.926133 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.926318 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.926421 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.926647 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.926755 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.926969 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.927074 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.927298 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.927397 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.927615 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.927722 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.927920 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.928020 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.928228 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.928325 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.928537 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.928631 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.928868 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.929013 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.929188 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.929297 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.929496 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.929587 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.929749 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.929849 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.930053 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.930158 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.930359 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.930450 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.930710 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.930813 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.931018 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.931125 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.931328 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.931421 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.931639 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.931729 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.931946 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.932071 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.932252 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.932356 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.932560 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.932651 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.932866 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.933012 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.933171 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.933289 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.933675 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.934055 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.934367 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.934566 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.934733 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.934888 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.935033 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.935188 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.935343 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.935520 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.935669 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.935833 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.935981 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.942982 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.943204 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.943204 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.943575 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.943895 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.944068 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.944228 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.944435 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.944603 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.944770 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.945022 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.945371 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.945548 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.945704 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.945960 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.946125 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.946280 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.946438 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.946699 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.946971 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.947668 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.947771 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.947869 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.947963 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.948049 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.948145 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.948228 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.948311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.948403 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.948492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.948584 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.948668 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.948762 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.948856 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.948951 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.949038 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.949117 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.949203 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.949278 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.949365 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.949446 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.949519 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.949609 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.949698 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.949796 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.949974 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.949974 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.950152 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.950237 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.950321 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.950426 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.950556 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.950646 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.950748 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.950843 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.950935 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.951039 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.951125 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.951216 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.951318 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.951411 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.951503 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.951602 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.951683 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.951755 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.951847 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.951926 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:25:25.952007 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.952105 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.952202 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.952287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.952371 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.952455 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.952538 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.952636 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.952744 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.952744 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.952917 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.953011 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.953114 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.953207 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.953300 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.953385 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.953476 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.953567 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.953661 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.953755 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.953841 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.953935 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.954035 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.954127 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.954233 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.954331 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.954428 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.954530 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.954615 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.954716 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.954813 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.954906 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.954991 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.955082 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.955165 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.955269 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.955356 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.955440 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.955537 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.955634 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.955727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.955826 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.955919 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.956005 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.956096 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.956182 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.956274 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.956375 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.956470 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.956564 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.956655 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.956747 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.956747 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.956922 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.956922 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.957097 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.957097 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.957280 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.957376 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.957471 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.957564 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.957656 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.957748 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.957833 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.957930 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.958022 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.958107 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.958197 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.958291 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.958378 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.958475 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.958602 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.958686 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.958772 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.958859 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.958942 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.959035 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.959134 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.959234 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.959326 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.959419 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.959556 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.959787 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.959885 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.959968 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.960061 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.960153 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.960319 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.960415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.960501 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.960585 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.960668 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.960753 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.960851 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.960937 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.961021 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.961103 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.961195 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.961420 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.961575 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.961718 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.961831 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.962012 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.962105 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.962329 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.962422 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.962657 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.962768 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.962979 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.963072 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.963288 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.963383 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.963602 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.963691 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.963902 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.963983 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.964210 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.964303 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.964523 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.964621 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.964973 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.965145 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.965334 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.965509 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.965647 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.965736 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.965821 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.965969 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.966113 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.966285 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.966430 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.966616 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.966768 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.966929 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.967093 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.967224 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.967403 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.967538 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.967713 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.967879 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.968037 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.968894 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.968979 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.969053 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.969053 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.969223 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.969453 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.969812 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.970133 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.970460 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.970813 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.971133 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.971466 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.971677 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.971839 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.972053 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.972224 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.972384 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.972554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.972898 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.973211 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.973542 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.973718 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.973871 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.974067 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.974187 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.974415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.974551 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.974770 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.974871 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.975119 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.975238 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.975415 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.975514 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.975720 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.975813 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.976030 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.976121 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.976382 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.976493 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.976643 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.976743 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.976952 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.977053 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.977256 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.977358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.977562 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.977651 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.977948 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.978067 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.978211 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.978378 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.978501 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.979534 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.979534 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.979723 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.979809 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.979916 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.980013 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.980101 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.980195 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.980311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.980486 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.980640 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.980751 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.980839 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.980923 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.981034 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.981186 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.981288 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.981375 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.981487 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.981576 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.981784 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.981922 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.982107 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.982268 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.982427 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.982699 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.982887 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.983043 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.983192 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.983342 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.983482 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.983635 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.983786 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.983882 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.983991 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.984083 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.984301 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.984401 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.984628 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.984730 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.984944 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.985312 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.985421 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.985521 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.985619 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.985835 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.985940 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.986156 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.986257 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.986475 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.986664 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.986817 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.986910 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.987148 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.987240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.987458 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.987552 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.987774 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.987871 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.988086 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.988219 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.988390 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.988486 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.988695 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.988796 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.989007 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.989166 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.989312 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.989447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.989602 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.989774 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.989889 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.990454 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.990573 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.990664 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.990747 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.990836 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.990919 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.991013 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.991108 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.991196 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.991365 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.991473 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.991666 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.991765 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.991978 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.992070 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.992276 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.992383 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.992588 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.992688 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.992889 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.992982 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.993214 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.993320 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.993518 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.993609 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.993820 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.993920 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.994121 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.994223 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.994427 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.994545 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.994807 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.994900 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.995110 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.995207 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.995515 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.995609 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.995733 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.995837 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.996128 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.996267 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.996407 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.996559 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.996730 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.996889 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.996990 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.997180 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.997282 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.997486 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.997587 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.997790 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.997884 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.998094 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.998194 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.998402 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.998539 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.998751 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.998845 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.999053 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.999142 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.999361 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.999462 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.999670 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.999771 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:25.999976 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.000069 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.000281 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.000383 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.000581 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.000680 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.000887 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.000987 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.001193 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.001294 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.001504 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.001597 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.001808 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.001906 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.002108 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.002209 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.002405 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.002496 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.002759 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.002871 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.003062 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.003176 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.003366 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.003458 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.003673 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.003764 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.003973 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.004075 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.004286 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.004387 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.004586 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.004678 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.004885 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.004978 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.005184 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.005276 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.005489 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.005595 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.005796 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.005904 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.006091 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.006184 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.006408 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.006506 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.006747 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.006842 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.007080 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.007171 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.007355 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.007466 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.007661 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.007762 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.007967 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.008057 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.008971 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.009124 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.009205 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.009285 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.009367 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.009441 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.009512 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.009597 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.009679 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.009793 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.009882 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.010094 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.010184 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.010475 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.010660 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.010750 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.010825 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.011016 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.011109 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.011315 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.011399 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.011736 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.011842 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.012054 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.012146 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.012364 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.012472 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.012671 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.012811 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.012987 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.013070 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.013296 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.013386 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.013606 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.013690 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.013914 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.013995 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.014224 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.014314 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.014558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.014665 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.014855 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.014953 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.015158 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.015303 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.015464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.015609 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.015787 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.015910 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.016124 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.016216 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.016405 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.016559 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.016709 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.016870 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.017067 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.017217 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.017343 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.017521 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.017649 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.017835 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.017942 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.018150 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.018247 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.018460 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.018624 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.018787 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.018933 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.019090 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.019276 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.019435 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.019607 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.019746 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.019954 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.020220 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.020319 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.020415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.020569 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.020742 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.020892 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.021056 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.021227 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.021383 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.021485 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.021653 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.021762 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.021964 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.022057 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.022265 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.022358 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.022599 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.022712 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.022908 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.023000 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.023219 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.023321 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.023531 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.023638 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.023840 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.023995 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.024153 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.024253 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.024463 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.024601 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.024767 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.024863 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.025082 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.025173 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.025391 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.025507 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.025698 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.025805 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.026004 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.026104 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.026339 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.026442 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.026639 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.026761 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.026947 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.027055 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.027387 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.027551 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.027802 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.027916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.028055 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.028253 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.028358 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.028658 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.028769 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.028960 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.029060 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.029268 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.029368 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.029571 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.029663 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.029875 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.029974 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.030184 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.030276 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.030497 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.030621 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.030830 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.030940 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.031130 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.031223 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.031440 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.031532 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.031745 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.031848 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.032061 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.032161 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.032371 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.032463 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.032695 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.032802 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.033319 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.033420 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.033625 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.033724 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.033937 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.034039 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.034236 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.034328 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.034555 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.034666 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.034862 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.034961 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.035170 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.035270 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.035545 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.035656 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.035755 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.035847 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.036114 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.036218 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.036361 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.036487 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.036663 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.036772 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.036987 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.037158 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.037296 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.037467 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.037603 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.037775 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.037913 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.038098 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.038237 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.038417 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.038586 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.038785 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.038895 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.039077 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.039254 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.039404 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.039548 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.039695 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.039847 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.040006 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.040154 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.040309 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.040462 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.040601 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.040770 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.040908 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.041085 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.041234 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.041376 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.041516 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.041692 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.041827 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.042014 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.042163 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.042311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.042452 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.042655 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.042901 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.043008 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.043272 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.043472 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.043570 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.043656 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.043887 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.043992 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.044207 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.044307 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.044508 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.044601 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.044809 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.044910 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.045116 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.045208 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.045420 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.045520 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.045729 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.045844 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.046035 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.046127 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.046339 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.046438 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.046670 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.046764 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.046975 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.047071 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.047280 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.047372 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.047582 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.047684 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.047883 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.047975 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.048192 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.048289 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.048491 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.048594 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.048797 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.048916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.049105 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.049200 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.049410 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.049501 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.049725 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.049818 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.050027 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.050142 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.050332 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.050423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.050660 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.050773 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.050969 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.051092 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.051278 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.051389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.051585 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.051694 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.051927 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.052037 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.052226 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.052331 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.052647 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.052955 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.053268 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.053362 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.053578 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.053667 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.053895 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.053992 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.054213 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.054306 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.054544 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.054631 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.054921 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.055016 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.055237 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.055338 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.055549 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.055638 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.055861 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.055967 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.056293 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.056593 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.056904 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.057205 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.057309 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.057504 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.057594 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.057804 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.057913 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.058112 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.058214 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.058505 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.058685 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.058864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.058946 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.059180 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.059298 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.059511 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.059606 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.059824 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.059922 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.060133 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.060242 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.060443 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.060581 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.060776 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.060920 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.061404 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.061518 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.061620 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.061716 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.061807 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.061895 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.061992 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.062169 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.062316 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.062498 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.062665 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.062847 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.062983 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.063178 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.063316 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.063489 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.063622 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.063813 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.063944 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.064127 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.064263 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.064458 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.064565 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.064794 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.064889 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.065117 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.065219 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.065441 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.065542 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.065751 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.065835 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.066080 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.066200 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.066380 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.066476 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.066720 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.066832 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.067028 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.067122 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.067338 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.067477 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.067808 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.067927 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.068127 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.068255 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.068455 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.068561 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.068788 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.068881 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.069104 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.069215 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.069419 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.069549 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.069731 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.069844 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.070047 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.070141 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.070360 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.070464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.070695 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.070805 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.071018 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.071121 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.071338 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.071434 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.071657 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.071751 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.071974 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.072068 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.072283 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.072381 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.072591 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.072691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.072920 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.073136 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.073257 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.073334 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.073539 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.073646 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.073855 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.073962 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.074238 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.074420 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.074654 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.074757 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.074997 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.075104 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.075341 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.075448 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.075636 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.075735 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.075942 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.076058 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.076252 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.076362 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.076558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.076731 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.076864 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.076955 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.077169 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.077269 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.077475 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.077575 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.077785 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.077878 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.078093 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.078193 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.078411 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.078503 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.078776 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.078868 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.079093 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.079187 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.079418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.079507 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.079711 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.079825 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.080025 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.080138 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.080331 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.080539 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.080642 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.080846 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.080939 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.081178 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.081292 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.081502 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.081657 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.081818 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.081917 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.082128 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.082237 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.082436 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.082592 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.083870 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.083991 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.084070 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.084147 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.084147 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.084300 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.084373 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.084443 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.084535 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.084616 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.084689 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.084759 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.084759 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.084894 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.084965 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.085043 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.085195 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.085286 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.085525 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.085623 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.085814 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.085911 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.086154 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.086374 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.086474 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.086740 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.086920 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.087050 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.087135 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.087495 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.087606 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.087708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.087810 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.087985 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.088080 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.088287 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.088379 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.088608 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.088712 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.088915 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.089009 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.089220 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.089321 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.089532 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.089670 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.090006 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.090164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.090301 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.090433 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.090753 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.090912 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.091068 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.091180 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.091466 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.091622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.091787 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.091953 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.092113 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.092265 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.092414 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.092572 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.092734 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.092886 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.093036 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.093194 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.093353 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.093515 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.093680 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.093853 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.094023 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.094174 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.094325 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.094576 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.094739 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.094892 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.095055 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.095215 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.095379 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.095542 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.095702 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.095863 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.096042 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.096202 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.096361 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.096522 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.096682 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.096849 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.097009 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.097168 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.097337 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.097595 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.097754 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.097906 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.098077 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.098234 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.098234 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.098566 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.098729 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.098891 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.099142 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.099300 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.099466 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.099619 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.099869 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.100025 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.100207 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.100445 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.100610 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.100770 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.100922 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.101072 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.101236 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.101396 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.101396 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.101692 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.101851 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.102011 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.102164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.102335 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.102497 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.102755 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.102908 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.103103 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.103276 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.103443 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.103605 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.103763 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.103916 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.104067 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.104228 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.104396 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.104555 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.104707 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.104857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.105014 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.105014 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.105384 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.105550 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.105702 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.105854 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.106013 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.106175 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.106337 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.106508 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.106684 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.106847 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.107009 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.107162 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.107313 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.107465 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.107640 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.107876 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.108053 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.108205 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.108364 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.108529 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.108680 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.108837 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.109005 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.109182 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.109405 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.109571 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.109723 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.109897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.110129 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.110293 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.110470 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.110736 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.110912 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.111074 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.111228 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.111379 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.111379 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.111682 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.111833 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.111998 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.112150 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.112309 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.112468 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.112633 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.112796 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.112957 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.113108 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.113259 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.113417 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.113568 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.113740 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.113903 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.114062 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.114214 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.114372 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.114566 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.114737 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.114908 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.115061 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.115211 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.115362 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.115522 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.115682 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.115843 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.115994 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.116146 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.116297 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.116456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.116607 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.116757 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.116757 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.117069 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.117221 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.117380 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.117531 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.117688 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.117841 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.118093 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.118257 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.118423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.118600 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.118767 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.118767 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.119080 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.119080 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.119398 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.119677 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.119843 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.119843 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.120421 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.120650 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.120903 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.121076 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.121230 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.121380 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.121551 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.121714 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.121875 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.122026 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.122178 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.122329 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.122488 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.122694 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.122855 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.123006 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.123171 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.123332 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.123483 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.123658 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.123821 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.123980 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.124139 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.124291 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.124451 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.124613 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.124766 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.124917 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.125121 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.125294 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.125531 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.125691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.125854 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.126012 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.126164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.126314 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.126314 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.126687 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.126687 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.126976 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.126976 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.127273 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.127442 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.127602 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.127765 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.127984 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.128244 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.128420 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.128581 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.128581 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.128886 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.129038 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.129196 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.129196 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.129503 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.129746 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.129902 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.130074 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.130227 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.130405 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.130655 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.130813 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.131062 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.131219 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.131371 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.131371 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.131671 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.131829 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.131981 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.132130 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.132306 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.132466 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.132618 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.132618 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.132920 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.133079 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.133240 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.133392 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.133550 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.133712 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.133870 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.134022 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.134193 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.134353 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.134562 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.134734 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.134886 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.134886 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.135185 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.135891 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.136056 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.136210 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.136369 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.136588 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.136793 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.136988 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.137142 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.137293 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.137452 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.137619 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.137772 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.137932 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.138084 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.138233 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.138397 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.138760 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.139020 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.139191 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.139345 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.139498 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.139664 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.139905 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.140071 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.140223 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.140382 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.140542 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.140787 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.140946 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.141186 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.141535 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.141697 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.141861 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.142035 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.142191 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.142191 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.142545 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.142702 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.142873 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.143028 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.143180 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.143330 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.143500 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.143670 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.143837 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.143989 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 15:25:26.144142 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.144142 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.144142 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.144142 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.144142 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.144142 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.144142 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.144142 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.145287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.145287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.145287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.145287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.145287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.145287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.145287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.145287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.146454 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.146454 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.146454 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.146454 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.146454 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.146454 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.146454 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.146454 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.147622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.147622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.147622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.147622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.147622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.147622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.148471 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.148471 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.148808 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.148808 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.149231 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.149397 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.149706 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.150030 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.150352 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.150900 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.151087 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.151342 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.151638 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.151954 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.152313 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.152731 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.153057 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.153370 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.153706 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.154033 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.154341 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.156016 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.156016 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.156016 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.156016 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.156016 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.160288 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.160288 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.160288 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.160288 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.160288 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.160288 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.160288 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.160288 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.161561 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.161561 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.161561 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.161561 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.161561 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.161561 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.161561 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.161561 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.162741 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.162741 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.162741 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.162741 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.162741 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.163543 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.163543 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:25:26.163543 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 15:25:26.292705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO dbcounter [None req-4dc6b3b8-50de-4c2b-8b5d-c31fc18fafa2 None None] Registered counter for database nova_api Jul 15 15:25:26.314309 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_db.sqlalchemy.engines [None req-4dc6b3b8-50de-4c2b-8b5d-c31fc18fafa2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117999) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:25:26.317493 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO dbcounter [None req-08a8f512-da33-4009-bc46-08080d0aa691 None None] Registered counter for database nova_api Jul 15 15:25:26.322891 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writer thread running {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:25:26.337982 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_db.sqlalchemy.engines [None req-08a8f512-da33-4009-bc46-08080d0aa691 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:25:26.345062 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writer thread running {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:25:26.381360 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.context [None req-4dc6b3b8-50de-4c2b-8b5d-c31fc18fafa2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),11a29c77-701d-47b2-97de-2677c43340d0(cell1) {{(pid=117999) load_cells /opt/stack/nova/nova/context.py:464}} Jul 15 15:25:26.385280 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4dc6b3b8-50de-4c2b-8b5d-c31fc18fafa2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:25:26.387113 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4dc6b3b8-50de-4c2b-8b5d-c31fc18fafa2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:25:26.387898 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4dc6b3b8-50de-4c2b-8b5d-c31fc18fafa2 None None] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:25:26.389877 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4dc6b3b8-50de-4c2b-8b5d-c31fc18fafa2 None None] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:25:26.391857 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO dbcounter [None req-4dc6b3b8-50de-4c2b-8b5d-c31fc18fafa2 None None] Registered counter for database nova_cell0 Jul 15 15:25:26.396026 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO dbcounter [None req-4dc6b3b8-50de-4c2b-8b5d-c31fc18fafa2 None None] Registered counter for database nova_cell1 Jul 15 15:25:26.402644 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.context [None req-08a8f512-da33-4009-bc46-08080d0aa691 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),11a29c77-701d-47b2-97de-2677c43340d0(cell1) {{(pid=117998) load_cells /opt/stack/nova/nova/context.py:464}} Jul 15 15:25:26.403672 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_db.sqlalchemy.engines [None req-4dc6b3b8-50de-4c2b-8b5d-c31fc18fafa2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117999) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:25:26.405389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_db.sqlalchemy.engines [None req-4dc6b3b8-50de-4c2b-8b5d-c31fc18fafa2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117999) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:25:26.406739 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-08a8f512-da33-4009-bc46-08080d0aa691 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:25:26.408679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-08a8f512-da33-4009-bc46-08080d0aa691 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:25:26.409489 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-08a8f512-da33-4009-bc46-08080d0aa691 None None] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:25:26.411560 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-08a8f512-da33-4009-bc46-08080d0aa691 None None] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:25:26.412800 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writer thread running {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:25:26.413132 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writer thread running {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:25:26.413581 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO dbcounter [None req-08a8f512-da33-4009-bc46-08080d0aa691 None None] Registered counter for database nova_cell0 Jul 15 15:25:26.417859 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO dbcounter [None req-08a8f512-da33-4009-bc46-08080d0aa691 None None] Registered counter for database nova_cell1 Jul 15 15:25:26.425170 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_db.sqlalchemy.engines [None req-08a8f512-da33-4009-bc46-08080d0aa691 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:25:26.427414 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_db.sqlalchemy.engines [None req-08a8f512-da33-4009-bc46-08080d0aa691 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:25:26.432509 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writer thread running {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:25:26.435527 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writer thread running {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:25:26.559010 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO dbcounter [None req-4dc6b3b8-50de-4c2b-8b5d-c31fc18fafa2 None None] Registered counter for database nova_cell0 Jul 15 15:25:26.566009 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_db.sqlalchemy.engines [None req-4dc6b3b8-50de-4c2b-8b5d-c31fc18fafa2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117999) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:25:26.571271 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writer thread running {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:25:26.580995 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO dbcounter [None req-08a8f512-da33-4009-bc46-08080d0aa691 None None] Registered counter for database nova_cell0 Jul 15 15:25:26.589812 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_db.sqlalchemy.engines [None req-08a8f512-da33-4009-bc46-08080d0aa691 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:25:26.595561 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writer thread running {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:25:26.886355 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: WARNING keystonemiddleware.auth_token [None req-4dc6b3b8-50de-4c2b-8b5d-c31fc18fafa2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 15:25:26.896511 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: WARNING keystonemiddleware.auth_token [None req-4dc6b3b8-50de-4c2b-8b5d-c31fc18fafa2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 15:25:26.926203 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: WARNING keystonemiddleware.auth_token [None req-08a8f512-da33-4009-bc46-08080d0aa691 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 15:25:26.936064 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: WARNING keystonemiddleware.auth_token [None req-08a8f512-da33-4009-bc46-08080d0aa691 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 15:25:27.265270 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: WARNING keystonemiddleware.auth_token [None req-4dc6b3b8-50de-4c2b-8b5d-c31fc18fafa2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 15:25:27.272658 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: WARNING keystonemiddleware.auth_token [None req-4dc6b3b8-50de-4c2b-8b5d-c31fc18fafa2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 15:25:27.282005 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559551e299c0 pid: 117999 (default app) Jul 15 15:25:27.312356 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: WARNING keystonemiddleware.auth_token [None req-08a8f512-da33-4009-bc46-08080d0aa691 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 15:25:27.320523 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: WARNING keystonemiddleware.auth_token [None req-08a8f512-da33-4009-bc46-08080d0aa691 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 15:25:27.329382 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559551e299c0 pid: 117998 (default app) Jul 15 15:26:09.390636 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=3 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:09.391841 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=3 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:09.393192 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=3 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:09.394280 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=3 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:10.299966 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=3 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:10.301528 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=3 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:10.303407 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=3 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:10.306713 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=3 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:10.915879 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-c9d68f50-93d4-42a3-8e6f-6fe87846d08d tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Action: 'create', calling method: .version_select at 0x7fe3c87fb940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-375676127"}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:26:12.503886 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-abd77f6a-c19c-4ddd-9e57-48eff95068aa tempest-VolumesGetTestJSON-1554445823 tempest-VolumesGetTestJSON-1554445823-project] Action: 'create', calling method: .version_select at 0x7fe3c87fd8b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1931523990", "metadata": {"Type": "work"}}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:26:13.590400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-c9d68f50-93d4-42a3-8e6f-6fe87846d08d tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.214278 Jul 15 15:26:13.591420 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 1/1] 10.222.0.40 () {60 vars in 1154 bytes} [Fri Jul 15 15:26:09 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4217 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 15 15:26:13.606371 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-ebb3b7b6-406f-4ab7-aa96-22805f1fd87e tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Calling method '.version_select at 0x7fe3c86c7790>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:14.315734 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-ebb3b7b6-406f-4ab7-aa96-22805f1fd87e tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/f6e2c6f7-d8b0-4d28-86db-ad61ded95e50" status: 200 len: 344 microversion: 2.1 time: 0.714622 Jul 15 15:26:14.316671 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 2/2] 10.222.0.40 () {58 vars in 1244 bytes} [Fri Jul 15 15:26:13 2022] GET /compute/v2.1/os-volumes/f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 => generated 344 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:26:14.451578 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-abd77f6a-c19c-4ddd-9e57-48eff95068aa tempest-VolumesGetTestJSON-1554445823 tempest-VolumesGetTestJSON-1554445823-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.165753 Jul 15 15:26:14.453951 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 1/3] 10.222.0.40 () {60 vars in 1155 bytes} [Fri Jul 15 15:26:10 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4170 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 15 15:26:14.466213 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-83092d2d-ee3c-435e-817a-3f232c41781a tempest-VolumesGetTestJSON-1554445823 tempest-VolumesGetTestJSON-1554445823-project] Calling method '.version_select at 0x7fe3c86c78b0>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:14.628902 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-83092d2d-ee3c-435e-817a-3f232c41781a tempest-VolumesGetTestJSON-1554445823 tempest-VolumesGetTestJSON-1554445823-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e8f8ca6d-a49b-43a4-bb93-592925fe4f96" status: 200 len: 353 microversion: 2.1 time: 0.166422 Jul 15 15:26:14.629830 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 3/4] 10.222.0.40 () {58 vars in 1244 bytes} [Fri Jul 15 15:26:14 2022] GET /compute/v2.1/os-volumes/e8f8ca6d-a49b-43a4-bb93-592925fe4f96 => generated 353 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:26:15.331868 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-37e71252-eb99-4abc-ad2e-4738717f83bd tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Calling method '.version_select at 0x7fe3c86c7700>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:15.516757 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-37e71252-eb99-4abc-ad2e-4738717f83bd tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/f6e2c6f7-d8b0-4d28-86db-ad61ded95e50" status: 200 len: 345 microversion: 2.1 time: 0.189219 Jul 15 15:26:15.529742 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 2/5] 10.222.0.40 () {58 vars in 1244 bytes} [Fri Jul 15 15:26:15 2022] GET /compute/v2.1/os-volumes/f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 => generated 345 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:26:15.531604 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-7017609c-0cdc-4255-80ca-de6f22ad4509 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Action: 'create', calling method: .version_select at 0x7fe3c86c7ee0>, body: {"snapshot": {"volume_id": "f6e2c6f7-d8b0-4d28-86db-ad61ded95e50", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-865672093"}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:26:15.641360 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-de20a344-5620-41d6-a403-75971d3494ac tempest-VolumesGetTestJSON-1554445823 tempest-VolumesGetTestJSON-1554445823-project] Calling method '.version_select at 0x7fe3c86c7a60>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:16.105072 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-7017609c-0cdc-4255-80ca-de6f22ad4509 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] 10.222.0.40 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.578760 Jul 15 15:26:16.110874 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 4/6] 10.222.0.40 () {60 vars in 1161 bytes} [Fri Jul 15 15:26:15 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:26:16.116034 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-6585a23d-3a9f-4a4f-b939-694fef66d4b9 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Calling method '.version_select at 0x7fe3c86ddb80>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:16.541482 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-de20a344-5620-41d6-a403-75971d3494ac tempest-VolumesGetTestJSON-1554445823 tempest-VolumesGetTestJSON-1554445823-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e8f8ca6d-a49b-43a4-bb93-592925fe4f96" status: 200 len: 354 microversion: 2.1 time: 0.903012 Jul 15 15:26:16.543006 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 3/7] 10.222.0.40 () {58 vars in 1244 bytes} [Fri Jul 15 15:26:15 2022] GET /compute/v2.1/os-volumes/e8f8ca6d-a49b-43a4-bb93-592925fe4f96 => generated 354 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:26:16.560915 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8876377e-cfbe-43d5-9477-bd1d5cffcf2a tempest-VolumesGetTestJSON-1554445823 tempest-VolumesGetTestJSON-1554445823-project] Calling method '.version_select at 0x7fe3c86c7ee0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:16.737160 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-6585a23d-3a9f-4a4f-b939-694fef66d4b9 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d133979f-343f-4868-9bb2-ef4ece86bf73" status: 200 len: 286 microversion: 2.1 time: 0.624651 Jul 15 15:26:16.737907 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 5/8] 10.222.0.40 () {58 vars in 1250 bytes} [Fri Jul 15 15:26:16 2022] GET /compute/v2.1/os-snapshots/d133979f-343f-4868-9bb2-ef4ece86bf73 => generated 286 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:26:16.749415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-222edd16-cb94-4ee8-8d12-57edc318f987 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Calling method '.version_select at 0x7fe3c86dd790>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:16.768707 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8876377e-cfbe-43d5-9477-bd1d5cffcf2a tempest-VolumesGetTestJSON-1554445823 tempest-VolumesGetTestJSON-1554445823-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e8f8ca6d-a49b-43a4-bb93-592925fe4f96" status: 200 len: 354 microversion: 2.1 time: 0.217354 Jul 15 15:26:16.769590 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 4/9] 10.222.0.40 () {58 vars in 1244 bytes} [Fri Jul 15 15:26:16 2022] GET /compute/v2.1/os-volumes/e8f8ca6d-a49b-43a4-bb93-592925fe4f96 => generated 354 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:26:16.787611 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3e1c4d3e-6902-44be-8b62-ae11d869a437 tempest-VolumesGetTestJSON-1554445823 tempest-VolumesGetTestJSON-1554445823-project] Calling method '.version_select at 0x7fe3c86dd5e0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:16.860403 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-222edd16-cb94-4ee8-8d12-57edc318f987 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.114922 Jul 15 15:26:16.861165 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 6/10] 10.222.0.40 () {58 vars in 1139 bytes} [Fri Jul 15 15:26:16 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:26:16.873415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-0ea8f3ff-796f-4432-bc80-6799695349d5 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Calling method '.version_select at 0x7fe3c86c7f70>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:16.926246 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-0ea8f3ff-796f-4432-bc80-6799695349d5 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d133979f-343f-4868-9bb2-ef4ece86bf73" status: 200 len: 286 microversion: 2.1 time: 0.057757 Jul 15 15:26:16.926847 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 7/11] 10.222.0.40 () {58 vars in 1250 bytes} [Fri Jul 15 15:26:16 2022] GET /compute/v2.1/os-snapshots/d133979f-343f-4868-9bb2-ef4ece86bf73 => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:26:16.949338 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3e1c4d3e-6902-44be-8b62-ae11d869a437 tempest-VolumesGetTestJSON-1554445823 tempest-VolumesGetTestJSON-1554445823-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/e8f8ca6d-a49b-43a4-bb93-592925fe4f96" status: 202 len: 0 microversion: 2.1 time: 0.166192 Jul 15 15:26:16.950444 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 5/12] 10.222.0.40 () {58 vars in 1247 bytes} [Fri Jul 15 15:26:16 2022] DELETE /compute/v2.1/os-volumes/e8f8ca6d-a49b-43a4-bb93-592925fe4f96 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:26:16.959424 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-301a03c3-b422-4bef-8179-8f1dd426f85b tempest-VolumesGetTestJSON-1554445823 tempest-VolumesGetTestJSON-1554445823-project] Calling method '.version_select at 0x7fe3c86c78b0>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:17.073777 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-301a03c3-b422-4bef-8179-8f1dd426f85b tempest-VolumesGetTestJSON-1554445823 tempest-VolumesGetTestJSON-1554445823-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e8f8ca6d-a49b-43a4-bb93-592925fe4f96" status: 200 len: 353 microversion: 2.1 time: 0.118919 Jul 15 15:26:17.075251 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 8/13] 10.222.0.40 () {58 vars in 1244 bytes} [Fri Jul 15 15:26:16 2022] GET /compute/v2.1/os-volumes/e8f8ca6d-a49b-43a4-bb93-592925fe4f96 => generated 353 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:26:17.951552 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1fde5229-33e7-4f25-8b7b-d5b09c017566 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Calling method '.version_select at 0x7fe3c86c75e0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:18.004038 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1fde5229-33e7-4f25-8b7b-d5b09c017566 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d133979f-343f-4868-9bb2-ef4ece86bf73" status: 200 len: 286 microversion: 2.1 time: 0.068668 Jul 15 15:26:18.004755 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 6/14] 10.222.0.40 () {58 vars in 1250 bytes} [Fri Jul 15 15:26:17 2022] GET /compute/v2.1/os-snapshots/d133979f-343f-4868-9bb2-ef4ece86bf73 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:26:18.093129 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-4cdad222-da20-4352-ba1e-c5d75d133f65 tempest-VolumesGetTestJSON-1554445823 tempest-VolumesGetTestJSON-1554445823-project] Calling method '.version_select at 0x7fe3c86c7dc0>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:18.172122 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-4cdad222-da20-4352-ba1e-c5d75d133f65 tempest-VolumesGetTestJSON-1554445823 tempest-VolumesGetTestJSON-1554445823-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e8f8ca6d-a49b-43a4-bb93-592925fe4f96" status: 200 len: 353 microversion: 2.1 time: 0.085747 Jul 15 15:26:18.172839 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 9/15] 10.222.0.40 () {58 vars in 1244 bytes} [Fri Jul 15 15:26:18 2022] GET /compute/v2.1/os-volumes/e8f8ca6d-a49b-43a4-bb93-592925fe4f96 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:26:19.026758 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-268d0517-52c7-4fe3-a209-6edfe6c05dc9 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Calling method '.version_select at 0x7fe3c86c7b80>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:19.093659 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-268d0517-52c7-4fe3-a209-6edfe6c05dc9 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d133979f-343f-4868-9bb2-ef4ece86bf73" status: 200 len: 286 microversion: 2.1 time: 0.080121 Jul 15 15:26:19.094198 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 7/16] 10.222.0.40 () {58 vars in 1250 bytes} [Fri Jul 15 15:26:19 2022] GET /compute/v2.1/os-snapshots/d133979f-343f-4868-9bb2-ef4ece86bf73 => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:26:19.189003 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-25633251-4ebf-4867-9b36-44650625bfe0 tempest-VolumesGetTestJSON-1554445823 tempest-VolumesGetTestJSON-1554445823-project] Calling method '.version_select at 0x7fe3c86ddee0>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:19.375986 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-25633251-4ebf-4867-9b36-44650625bfe0 tempest-VolumesGetTestJSON-1554445823 tempest-VolumesGetTestJSON-1554445823-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e8f8ca6d-a49b-43a4-bb93-592925fe4f96" status: 200 len: 353 microversion: 2.1 time: 0.194315 Jul 15 15:26:19.376950 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 10/17] 10.222.0.40 () {58 vars in 1244 bytes} [Fri Jul 15 15:26:19 2022] GET /compute/v2.1/os-volumes/e8f8ca6d-a49b-43a4-bb93-592925fe4f96 => generated 353 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:26:20.107234 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0a4363f0-7572-4b13-a058-23342d1f76c9 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Calling method '.version_select at 0x7fe3c86dd310>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:20.172610 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-0a4363f0-7572-4b13-a058-23342d1f76c9 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d133979f-343f-4868-9bb2-ef4ece86bf73" status: 200 len: 286 microversion: 2.1 time: 0.070398 Jul 15 15:26:20.177032 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 8/18] 10.222.0.40 () {58 vars in 1250 bytes} [Fri Jul 15 15:26:20 2022] GET /compute/v2.1/os-snapshots/d133979f-343f-4868-9bb2-ef4ece86bf73 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:26:20.389532 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-88b73632-4b3e-4417-817a-a79fadfd616d tempest-VolumesGetTestJSON-1554445823 tempest-VolumesGetTestJSON-1554445823-project] Calling method '.version_select at 0x7fe3c86dd310>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:20.473665 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-88b73632-4b3e-4417-817a-a79fadfd616d tempest-VolumesGetTestJSON-1554445823 tempest-VolumesGetTestJSON-1554445823-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e8f8ca6d-a49b-43a4-bb93-592925fe4f96" status: 200 len: 353 microversion: 2.1 time: 0.087870 Jul 15 15:26:20.474295 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 11/19] 10.222.0.40 () {58 vars in 1244 bytes} [Fri Jul 15 15:26:20 2022] GET /compute/v2.1/os-volumes/e8f8ca6d-a49b-43a4-bb93-592925fe4f96 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:26:21.186677 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ec16b967-7ccf-483f-a1aa-2dc0471e1f7a tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Calling method '.version_select at 0x7fe3c86c7a60>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:21.253295 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ec16b967-7ccf-483f-a1aa-2dc0471e1f7a tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d133979f-343f-4868-9bb2-ef4ece86bf73" status: 200 len: 286 microversion: 2.1 time: 0.071497 Jul 15 15:26:21.253875 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 9/20] 10.222.0.40 () {58 vars in 1250 bytes} [Fri Jul 15 15:26:21 2022] GET /compute/v2.1/os-snapshots/d133979f-343f-4868-9bb2-ef4ece86bf73 => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:26:21.370557 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-28cc7788-2da5-474a-9c69-785c666c8a53 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Action: 'create', calling method: .version_select at 0x7fe3c86dd790>, body: {"keypair": {"name": "tempest-keypair-533294991", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJa6t+8KufX19f6liHI6MAXmnXqrMy+dDaux2EGIq8j6XbWhljrPnLAQZdZkITJSl9xfvARCKWApRsWO2bOD9OX7VOkmQggKQolZ+yLJHYrBy3DaY+bluh3yD9EpZr3A9w=="}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:26:21.448189 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-28cc7788-2da5-474a-9c69-785c666c8a53 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Getting quotas for project 83cbbde066834f25a1b6f1bdc28e8b79. Resources: {'key_pairs'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:26:21.456386 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-28cc7788-2da5-474a-9c69-785c666c8a53 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Getting quotas for user 9a0d49b3b50b4e668e157cb2e8e47da2 and project 83cbbde066834f25a1b6f1bdc28e8b79. Resources: {'key_pairs'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:26:21.487021 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a5495983-997d-4914-a1cb-4aba1ae7b255 tempest-VolumesGetTestJSON-1554445823 tempest-VolumesGetTestJSON-1554445823-project] Calling method '.version_select at 0x7fe3c86c7ee0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:21.541365 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-28cc7788-2da5-474a-9c69-785c666c8a53 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.262998 Jul 15 15:26:21.541976 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 12/21] 10.222.0.40 () {62 vars in 1199 bytes} [Fri Jul 15 15:26:21 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 265 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 15 15:26:21.570786 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a5495983-997d-4914-a1cb-4aba1ae7b255 tempest-VolumesGetTestJSON-1554445823 tempest-VolumesGetTestJSON-1554445823-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e8f8ca6d-a49b-43a4-bb93-592925fe4f96" status: 200 len: 353 microversion: 2.1 time: 0.087829 Jul 15 15:26:21.571610 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 10/22] 10.222.0.40 () {58 vars in 1244 bytes} [Fri Jul 15 15:26:21 2022] GET /compute/v2.1/os-volumes/e8f8ca6d-a49b-43a4-bb93-592925fe4f96 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:26:22.267585 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3165926d-2c83-4e95-8312-37cef0e5b813 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Calling method '.version_select at 0x7fe3c8636b80>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:22.336953 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-3165926d-2c83-4e95-8312-37cef0e5b813 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d133979f-343f-4868-9bb2-ef4ece86bf73" status: 200 len: 286 microversion: 2.1 time: 0.075150 Jul 15 15:26:22.337587 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 13/23] 10.222.0.40 () {58 vars in 1250 bytes} [Fri Jul 15 15:26:22 2022] GET /compute/v2.1/os-snapshots/d133979f-343f-4868-9bb2-ef4ece86bf73 => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:26:22.585470 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f52cbf93-4d7c-407f-87c7-8a7c0e73172c tempest-VolumesGetTestJSON-1554445823 tempest-VolumesGetTestJSON-1554445823-project] Calling method '.version_select at 0x7fe3c86dd4c0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:22.737359 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f52cbf93-4d7c-407f-87c7-8a7c0e73172c tempest-VolumesGetTestJSON-1554445823 tempest-VolumesGetTestJSON-1554445823-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e8f8ca6d-a49b-43a4-bb93-592925fe4f96" status: 200 len: 353 microversion: 2.1 time: 0.156419 Jul 15 15:26:22.744236 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 11/24] 10.222.0.40 () {58 vars in 1244 bytes} [Fri Jul 15 15:26:22 2022] GET /compute/v2.1/os-volumes/e8f8ca6d-a49b-43a4-bb93-592925fe4f96 => generated 353 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:26:23.355388 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-741cca47-f13a-4797-9715-f20c193a74c3 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Calling method '.version_select at 0x7fe3c866a280>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:23.439703 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-741cca47-f13a-4797-9715-f20c193a74c3 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d133979f-343f-4868-9bb2-ef4ece86bf73" status: 200 len: 287 microversion: 2.1 time: 0.093119 Jul 15 15:26:23.440756 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 14/25] 10.222.0.40 () {58 vars in 1250 bytes} [Fri Jul 15 15:26:23 2022] GET /compute/v2.1/os-snapshots/d133979f-343f-4868-9bb2-ef4ece86bf73 => generated 287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:26:23.453966 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1e355137-61d5-4d6d-8d83-4dfd30b211e4 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Calling method '.version_select at 0x7fe3c86dde50>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:23.650974 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1e355137-61d5-4d6d-8d83-4dfd30b211e4 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] 10.222.0.40 "DELETE /compute/v2.1/os-snapshots/d133979f-343f-4868-9bb2-ef4ece86bf73" status: 202 len: 0 microversion: 2.1 time: 0.202788 Jul 15 15:26:23.653078 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 12/26] 10.222.0.40 () {58 vars in 1253 bytes} [Fri Jul 15 15:26:23 2022] DELETE /compute/v2.1/os-snapshots/d133979f-343f-4868-9bb2-ef4ece86bf73 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 15:26:23.664370 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-8771653b-60c8-468f-8d12-d43a62b3fcde tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Calling method '.version_select at 0x7fe3c866a940>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:23.756093 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-8771653b-60c8-468f-8d12-d43a62b3fcde tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d133979f-343f-4868-9bb2-ef4ece86bf73" status: 200 len: 286 microversion: 2.1 time: 0.097450 Jul 15 15:26:23.757112 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 15/27] 10.222.0.40 () {58 vars in 1250 bytes} [Fri Jul 15 15:26:23 2022] GET /compute/v2.1/os-snapshots/d133979f-343f-4868-9bb2-ef4ece86bf73 => generated 286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:26:23.757970 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-13ffc7aa-fefa-4ca2-aa10-37073c8f3edb tempest-VolumesGetTestJSON-1554445823 tempest-VolumesGetTestJSON-1554445823-project] Calling method '.version_select at 0x7fe3c86ddaf0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:23.848874 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-13ffc7aa-fefa-4ca2-aa10-37073c8f3edb tempest-VolumesGetTestJSON-1554445823 tempest-VolumesGetTestJSON-1554445823-project] HTTP exception thrown: Volume e8f8ca6d-a49b-43a4-bb93-592925fe4f96 could not be found. Jul 15 15:26:23.855255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-13ffc7aa-fefa-4ca2-aa10-37073c8f3edb tempest-VolumesGetTestJSON-1554445823 tempest-VolumesGetTestJSON-1554445823-project] Request method failure captured: Jul 15 15:26:23.855255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/os-volumes/e8f8ca6d-a49b-43a4-bb93-592925fe4f96 HTTP/1.1 Jul 15 15:26:23.855255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:26:23.855255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:26:23.855255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:26:23.855255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 15 15:26:23.855255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:26:23.855255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:26:23.855255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:26:23.855255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:26:23.855255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0YcSympK_xerDkREKg9pa_A2Cp6xmnZE0FxtxfoVeV9Ow6cGVQN5kMSS3jqg21LAGSZRJIhPjx8ppW-aYwQmm_w-LMK7m5cFZ3igMxCOSTzgjXrk34ym0wy2xGOHNenYKPH1FDuHZkkfKg155f5JIp09EVK5Y5R5pOGuBAh0aogkQVM Jul 15 15:26:23.855255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:26:23.855255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:26:23.855255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:26:23.855255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:26:23.855255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:26:23.855255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:26:23.855255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: 154d83d3acca49b0b07aceb57c6fa4ed Jul 15 15:26:23.855255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-VolumesGetTestJSON-1554445823 Jul 15 15:26:23.855255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:26:23.855255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:26:23.856724 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/154d83d3acca49b0b07aceb57c6fa4ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_154d83d3acca49b0b07aceb57c6fa4ed", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/154d83d3acca49b0b07aceb57c6fa4ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/154d83d3acca49b0b07aceb57c6fa4ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:26:23.856724 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-VolumesGetTestJSON-1554445823 Jul 15 15:26:23.856724 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 154d83d3acca49b0b07aceb57c6fa4ed Jul 15 15:26:23.856724 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-VolumesGetTestJSON-1554445823 Jul 15 15:26:23.856724 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-VolumesGetTestJSON-1554445823-project Jul 15 15:26:23.856724 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:26:23.856724 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:26:23.856724 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: 1f963e5fd1474a9fb209410f22e783e8 Jul 15 15:26:23.856724 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-VolumesGetTestJSON-1554445823-project Jul 15 15:26:23.856724 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: Jul 15 15:26:23.856724 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Volume e8f8ca6d-a49b-43a4-bb93-592925fe4f96 could not be found. Jul 15 15:26:23.856724 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'id': 'e8f8ca6d-a49b-43a4-bb93-592925fe4f96'} Jul 15 15:26:23.856724 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:26:23.857538 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:26:23.857538 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 15:26:23.857538 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 15:26:23.857538 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 15:26:23.857538 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 15:26:23.857538 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 15:26:23.857538 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 15:26:23.857538 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 15:26:23.857538 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 15:26:23.857538 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 15:26:23.857538 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 15:26:23.857538 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:26:23.857538 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:26:23.857538 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:26:23.857538 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:26:23.857538 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e8f8ca6d-a49b-43a4-bb93-592925fe4f96 could not be found. (HTTP 404) (Request-ID: req-004ea60c-ad8e-461a-aef4-8c3f57b8329f) Jul 15 15:26:23.857538 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:26:23.857538 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:26:23.857538 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:26:23.858692 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:26:23.858692 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 15 15:26:23.858692 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 15 15:26:23.858692 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 15:26:23.858692 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 15:26:23.858692 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 15:26:23.858692 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 15:26:23.858692 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 15:26:23.858692 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 15:26:23.858692 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 15:26:23.858692 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 15:26:23.858692 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 15:26:23.858692 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 15:26:23.858692 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 15:26:23.858692 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 15:26:23.858692 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 15:26:23.858692 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 15:26:23.858692 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 15:26:23.858692 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 15:26:23.859808 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:26:23.859808 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:26:23.859808 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:26:23.859808 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:26:23.859808 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e8f8ca6d-a49b-43a4-bb93-592925fe4f96 could not be found. Jul 15 15:26:23.859808 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:26:23.859808 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:26:23.859808 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:26:23.859808 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:26:23.859808 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:26:23.859808 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:26:23.859808 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:26:23.859808 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:26:23.859808 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 15:26:23.859808 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 15:26:23.859808 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:26:23.859808 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:26:23.859808 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 15 15:26:23.859808 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:26:23.860938 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e8f8ca6d-a49b-43a4-bb93-592925fe4f96 could not be found. Jul 15 15:26:23.860938 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:26:23.860938 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:26:23.860938 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:26:23.860938 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:26:23.860938 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:26:23.860938 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:26:23.860938 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:26:23.860938 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:26:23.860938 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e8f8ca6d-a49b-43a4-bb93-592925fe4f96 could not be found. Jul 15 15:26:23.860938 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:26:23.860938 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-13ffc7aa-fefa-4ca2-aa10-37073c8f3edb tempest-VolumesGetTestJSON-1554445823 tempest-VolumesGetTestJSON-1554445823-project] Returning 404 to user: Volume e8f8ca6d-a49b-43a4-bb93-592925fe4f96 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:26:23.861639 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-13ffc7aa-fefa-4ca2-aa10-37073c8f3edb tempest-VolumesGetTestJSON-1554445823 tempest-VolumesGetTestJSON-1554445823-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e8f8ca6d-a49b-43a4-bb93-592925fe4f96" status: 404 len: 109 microversion: 2.1 time: 0.112409 Jul 15 15:26:23.862977 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 13/28] 10.222.0.40 () {58 vars in 1244 bytes} [Fri Jul 15 15:26:23 2022] GET /compute/v2.1/os-volumes/e8f8ca6d-a49b-43a4-bb93-592925fe4f96 => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 15 15:26:24.769207 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-cd63d1bc-59bd-43b5-80fa-69b981fc5f5e tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Calling method '.version_select at 0x7fe3c8636dc0>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:24.836511 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.wsgi [None req-cd63d1bc-59bd-43b5-80fa-69b981fc5f5e tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] HTTP exception thrown: Snapshot d133979f-343f-4868-9bb2-ef4ece86bf73 could not be found. Jul 15 15:26:24.841257 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-cd63d1bc-59bd-43b5-80fa-69b981fc5f5e tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Request method failure captured: Jul 15 15:26:24.841257 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: request: GET /compute/v2.1/os-snapshots/d133979f-343f-4868-9bb2-ef4ece86bf73 HTTP/1.1 Jul 15 15:26:24.841257 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept: application/json Jul 15 15:26:24.841257 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept-Encoding: identity Jul 15 15:26:24.841257 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Connection: close Jul 15 15:26:24.841257 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Length: 0 Jul 15 15:26:24.841257 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Type: application/json Jul 15 15:26:24.841257 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Host: 10.222.0.40 Jul 15 15:26:24.841257 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Openstack-System-Scope: None Jul 15 15:26:24.841257 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: User-Agent: python-urllib3/1.26.9 Jul 15 15:26:24.841257 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Auth-Token: gAAAAABi0YcRrP96DtrYsHEkaIUWdaEfCwg7vQEeIqR5HWvD6Y_yuc-EiShTY1huFm9t7Cmq8OY2fG2CKw-z0pDR93fgqjlx-rZ3pyv2hGDGbhYE_IdtQgA4VLSQEsLzM7E64vNwe73mGefZGAGI8P2m0rJGfTUI8ZD6Tr7AnnGUr00cJYXtITw Jul 15 15:26:24.841257 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Id: None Jul 15 15:26:24.841257 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Name: None Jul 15 15:26:24.841257 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Identity-Status: Confirmed Jul 15 15:26:24.841257 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Is-Admin-Project: True Jul 15 15:26:24.841257 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Id: default Jul 15 15:26:24.841257 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Name: Default Jul 15 15:26:24.841257 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Id: 1b2864575fba44f29d22c7afb207a73b Jul 15 15:26:24.841257 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2031113326 Jul 15 15:26:24.841257 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Role: member,reader Jul 15 15:26:24.841257 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Roles: member,reader Jul 15 15:26:24.842423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1b2864575fba44f29d22c7afb207a73b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1b2864575fba44f29d22c7afb207a73b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1b2864575fba44f29d22c7afb207a73b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1b2864575fba44f29d22c7afb207a73b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:26:24.842423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2031113326 Jul 15 15:26:24.842423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Id: 1b2864575fba44f29d22c7afb207a73b Jul 15 15:26:24.842423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2031113326 Jul 15 15:26:24.842423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User: tempest-VolumesSnapshotsTestJSON-2031113326-project Jul 15 15:26:24.842423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Id: default Jul 15 15:26:24.842423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Name: Default Jul 15 15:26:24.842423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Id: 5e6af511fedd4788b1b771db772251f3 Jul 15 15:26:24.842423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2031113326-project Jul 15 15:26:24.842423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: method: Jul 15 15:26:24.842423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: exception: Snapshot d133979f-343f-4868-9bb2-ef4ece86bf73 could not be found. Jul 15 15:26:24.842423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: action_args: {'id': 'd133979f-343f-4868-9bb2-ef4ece86bf73'} Jul 15 15:26:24.842423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:26:24.843156 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:26:24.843156 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 15 15:26:24.843156 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 15 15:26:24.843156 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 15 15:26:24.843156 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 15 15:26:24.843156 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 15 15:26:24.843156 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 15 15:26:24.843156 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 15:26:24.843156 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 15:26:24.843156 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 15:26:24.843156 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 15:26:24.843156 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:26:24.843156 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:26:24.843156 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:26:24.843156 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:26:24.843156 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d133979f-343f-4868-9bb2-ef4ece86bf73 could not be found. (HTTP 404) (Request-ID: req-7923fec9-5c95-4f7a-9bb1-045b514c2eea) Jul 15 15:26:24.843156 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:26:24.843156 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:26:24.843990 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:26:24.843990 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:26:24.843990 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 15 15:26:24.843990 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 15 15:26:24.843990 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 15:26:24.843990 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 15:26:24.843990 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 15 15:26:24.843990 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 15 15:26:24.843990 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 15:26:24.843990 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 15:26:24.843990 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 15 15:26:24.843990 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 15 15:26:24.843990 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 15 15:26:24.843990 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 15 15:26:24.843990 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 15 15:26:24.843990 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 15 15:26:24.843990 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 15:26:24.843990 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 15:26:24.843990 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 15:26:24.844916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 15:26:24.844916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:26:24.844916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:26:24.844916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:26:24.844916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:26:24.844916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d133979f-343f-4868-9bb2-ef4ece86bf73 could not be found. Jul 15 15:26:24.844916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:26:24.844916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:26:24.844916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:26:24.844916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:26:24.844916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:26:24.844916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:26:24.844916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:26:24.844916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:26:24.844916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 15:26:24.844916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 15:26:24.844916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:26:24.844916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:26:24.844916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 15 15:26:24.844916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:26:24.845840 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d133979f-343f-4868-9bb2-ef4ece86bf73 could not be found. Jul 15 15:26:24.845840 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:26:24.845840 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:26:24.845840 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:26:24.845840 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:26:24.845840 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:26:24.845840 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:26:24.845840 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:26:24.845840 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:26:24.845840 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d133979f-343f-4868-9bb2-ef4ece86bf73 could not be found. Jul 15 15:26:24.845840 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:26:24.845840 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-cd63d1bc-59bd-43b5-80fa-69b981fc5f5e tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Returning 404 to user: Snapshot d133979f-343f-4868-9bb2-ef4ece86bf73 could not be found. {{(pid=117999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:26:24.845840 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-cd63d1bc-59bd-43b5-80fa-69b981fc5f5e tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d133979f-343f-4868-9bb2-ef4ece86bf73" status: 404 len: 111 microversion: 2.1 time: 0.077920 Jul 15 15:26:24.860642 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-822a2314-e54d-4da8-934c-511eb3f07136 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Calling method '.version_select at 0x7fe3c90ad9d0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:24.864677 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 16/29] 10.222.0.40 () {58 vars in 1250 bytes} [Fri Jul 15 15:26:24 2022] GET /compute/v2.1/os-snapshots/d133979f-343f-4868-9bb2-ef4ece86bf73 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:26:25.146771 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-822a2314-e54d-4da8-934c-511eb3f07136 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/f6e2c6f7-d8b0-4d28-86db-ad61ded95e50" status: 202 len: 0 microversion: 2.1 time: 0.298605 Jul 15 15:26:25.151516 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 14/30] 10.222.0.40 () {58 vars in 1247 bytes} [Fri Jul 15 15:26:24 2022] DELETE /compute/v2.1/os-volumes/f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:26:25.159572 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-2e0e5d20-5907-4c69-b854-0031786ad8c3 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Calling method '.version_select at 0x7fe3c86c7a60>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:25.324682 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-2e0e5d20-5907-4c69-b854-0031786ad8c3 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/f6e2c6f7-d8b0-4d28-86db-ad61ded95e50" status: 200 len: 344 microversion: 2.1 time: 0.172074 Jul 15 15:26:25.325729 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 17/31] 10.222.0.40 () {58 vars in 1244 bytes} [Fri Jul 15 15:26:25 2022] GET /compute/v2.1/os-volumes/f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 => generated 344 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:26:25.748935 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b7601089-1bd1-49fa-a399-1b26af8d5e28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-949369444", "imageRef": "b9770891-ef3b-4f53-a989-3a4db420d5c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3a5f9cec-c0c2-4330-acd4-167ce1985800"}], "security_groups": [{"name": "tempest-securitygroup--118130456"}], "key_name": "tempest-keypair-533294991", "user_data": "}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:26:26.101490 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.network.neutron [None req-b7601089-1bd1-49fa-a399-1b26af8d5e28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] validate_networks() for [('3a5f9cec-c0c2-4330-acd4-167ce1985800', None, None, None, None, None)] {{(pid=117998) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:26:26.339145 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-5f338872-f2e5-44ba-b4dc-87654e598950 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Calling method '.version_select at 0x7fe3c7dc6280>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:26.471727 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-5f338872-f2e5-44ba-b4dc-87654e598950 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/f6e2c6f7-d8b0-4d28-86db-ad61ded95e50" status: 200 len: 344 microversion: 2.1 time: 0.138101 Jul 15 15:26:26.473031 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 18/32] 10.222.0.40 () {58 vars in 1244 bytes} [Fri Jul 15 15:26:26 2022] GET /compute/v2.1/os-volumes/f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:26:27.486246 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-1beb20d2-a23f-4849-b5a8-8b555db58688 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Calling method '.version_select at 0x7fe3c7dc6940>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:27.611673 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-1beb20d2-a23f-4849-b5a8-8b555db58688 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/f6e2c6f7-d8b0-4d28-86db-ad61ded95e50" status: 200 len: 344 microversion: 2.1 time: 0.128211 Jul 15 15:26:27.616390 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 19/33] 10.222.0.40 () {58 vars in 1244 bytes} [Fri Jul 15 15:26:27 2022] GET /compute/v2.1/os-volumes/f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 => generated 344 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:26:28.603990 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-b7601089-1bd1-49fa-a399-1b26af8d5e28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Flavor limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:26:28.604627 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-b7601089-1bd1-49fa-a399-1b26af8d5e28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Image limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:26:28.605795 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-b7601089-1bd1-49fa-a399-1b26af8d5e28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Flavor pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:26:28.607386 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-b7601089-1bd1-49fa-a399-1b26af8d5e28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Image pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:26:28.607873 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-b7601089-1bd1-49fa-a399-1b26af8d5e28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:26:28.631808 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-c445a896-21e2-4efd-b553-fc92d3c0ad91 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Calling method '.version_select at 0x7fe3c7dd3040>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:28.647636 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b7601089-1bd1-49fa-a399-1b26af8d5e28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:28.652987 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b7601089-1bd1-49fa-a399-1b26af8d5e28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:28.654197 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b7601089-1bd1-49fa-a399-1b26af8d5e28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:28.656900 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b7601089-1bd1-49fa-a399-1b26af8d5e28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:28.750459 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-c445a896-21e2-4efd-b553-fc92d3c0ad91 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/f6e2c6f7-d8b0-4d28-86db-ad61ded95e50" status: 200 len: 344 microversion: 2.1 time: 0.126281 Jul 15 15:26:28.758344 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 20/34] 10.222.0.40 () {58 vars in 1244 bytes} [Fri Jul 15 15:26:28 2022] GET /compute/v2.1/os-volumes/f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 => generated 344 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:26:28.783045 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-b7601089-1bd1-49fa-a399-1b26af8d5e28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Getting quotas for project 83cbbde066834f25a1b6f1bdc28e8b79. Resources: {'ram', 'instances', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:26:28.794919 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-b7601089-1bd1-49fa-a399-1b26af8d5e28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Getting quotas for user 9a0d49b3b50b4e668e157cb2e8e47da2 and project 83cbbde066834f25a1b6f1bdc28e8b79. Resources: {'ram', 'instances', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:26:28.823261 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b7601089-1bd1-49fa-a399-1b26af8d5e28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Going to run 1 instances... {{(pid=117998) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:26:28.827746 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b7601089-1bd1-49fa-a399-1b26af8d5e28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9770891-ef3b-4f53-a989-3a4db420d5c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117998) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:26:29.039354 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b7601089-1bd1-49fa-a399-1b26af8d5e28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.295389 Jul 15 15:26:29.052812 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 15/35] 10.222.0.40 () {62 vars in 1187 bytes} [Fri Jul 15 15:26:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 3308 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 15 15:26:29.059325 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-18441ec2-2cdb-493f-bc59-ba0f584b85c7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:29.059997 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-18441ec2-2cdb-493f-bc59-ba0f584b85c7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:26:29.358039 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-18441ec2-2cdb-493f-bc59-ba0f584b85c7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:29.392563 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-18441ec2-2cdb-493f-bc59-ba0f584b85c7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:29.403429 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-18441ec2-2cdb-493f-bc59-ba0f584b85c7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:29.405008 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-18441ec2-2cdb-493f-bc59-ba0f584b85c7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1280 microversion: 2.20 time: 0.350217 Jul 15 15:26:29.420979 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 21/36] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:26:29 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1280 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:26:29.539785 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e45e81e1-85ab-48c1-a977-c546dcd5d5b8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Action: 'create', calling method: .version_select at 0x7fe3c7d3dca0>, body: {"keypair": {"name": "tempest-keypair-823981827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPamlHs5tI7TgrVFOS359GPTFX53RYx71Tju1cQs/sPEmfWeYHSJteRb2cOcDVfhyf4PEhyEOzRVzGC/Q9rFoSYRSMxXVcZBOTuDgjzwvhISsszF8G1ekWbuUA0UePM3og=="}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:26:29.597975 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-e45e81e1-85ab-48c1-a977-c546dcd5d5b8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Getting quotas for project 5e51044e804442909f18288b9a6430a5. Resources: {'key_pairs'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:26:29.615739 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-e45e81e1-85ab-48c1-a977-c546dcd5d5b8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Getting quotas for user 08050c1635084492a4b054b172884af8 and project 5e51044e804442909f18288b9a6430a5. Resources: {'key_pairs'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:26:29.755697 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e45e81e1-85ab-48c1-a977-c546dcd5d5b8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.615091 Jul 15 15:26:29.767386 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 16/37] 10.222.0.40 () {60 vars in 1158 bytes} [Fri Jul 15 15:26:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:26:29.774261 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-581bb32b-256b-4a12-9fb9-69aed97031a1 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Calling method '.version_select at 0x7fe3c7d8e550>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:29.893527 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.wsgi [None req-581bb32b-256b-4a12-9fb9-69aed97031a1 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] HTTP exception thrown: Volume f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 could not be found. Jul 15 15:26:29.898389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-581bb32b-256b-4a12-9fb9-69aed97031a1 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Request method failure captured: Jul 15 15:26:29.898389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: request: GET /compute/v2.1/os-volumes/f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 HTTP/1.1 Jul 15 15:26:29.898389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept: application/json Jul 15 15:26:29.898389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept-Encoding: identity Jul 15 15:26:29.898389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Connection: close Jul 15 15:26:29.898389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Length: 0 Jul 15 15:26:29.898389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Type: application/json Jul 15 15:26:29.898389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Host: 10.222.0.40 Jul 15 15:26:29.898389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Openstack-System-Scope: None Jul 15 15:26:29.898389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: User-Agent: python-urllib3/1.26.9 Jul 15 15:26:29.898389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Auth-Token: gAAAAABi0YcRrP96DtrYsHEkaIUWdaEfCwg7vQEeIqR5HWvD6Y_yuc-EiShTY1huFm9t7Cmq8OY2fG2CKw-z0pDR93fgqjlx-rZ3pyv2hGDGbhYE_IdtQgA4VLSQEsLzM7E64vNwe73mGefZGAGI8P2m0rJGfTUI8ZD6Tr7AnnGUr00cJYXtITw Jul 15 15:26:29.898389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Id: None Jul 15 15:26:29.898389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Name: None Jul 15 15:26:29.898389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Identity-Status: Confirmed Jul 15 15:26:29.898389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Is-Admin-Project: True Jul 15 15:26:29.898389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Id: default Jul 15 15:26:29.898389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Name: Default Jul 15 15:26:29.898389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Id: 1b2864575fba44f29d22c7afb207a73b Jul 15 15:26:29.898389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2031113326 Jul 15 15:26:29.898389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Role: member,reader Jul 15 15:26:29.898389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Roles: member,reader Jul 15 15:26:29.899996 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1b2864575fba44f29d22c7afb207a73b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1b2864575fba44f29d22c7afb207a73b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1b2864575fba44f29d22c7afb207a73b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1b2864575fba44f29d22c7afb207a73b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:26:29.899996 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2031113326 Jul 15 15:26:29.899996 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Id: 1b2864575fba44f29d22c7afb207a73b Jul 15 15:26:29.899996 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2031113326 Jul 15 15:26:29.899996 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User: tempest-VolumesSnapshotsTestJSON-2031113326-project Jul 15 15:26:29.899996 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Id: default Jul 15 15:26:29.899996 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Name: Default Jul 15 15:26:29.899996 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Id: 5e6af511fedd4788b1b771db772251f3 Jul 15 15:26:29.899996 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2031113326-project Jul 15 15:26:29.899996 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: method: Jul 15 15:26:29.899996 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: exception: Volume f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 could not be found. Jul 15 15:26:29.899996 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: action_args: {'id': 'f6e2c6f7-d8b0-4d28-86db-ad61ded95e50'} Jul 15 15:26:29.899996 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:26:29.900691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:26:29.900691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 15:26:29.900691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 15:26:29.900691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 15:26:29.900691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 15:26:29.900691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 15:26:29.900691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 15:26:29.900691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 15:26:29.900691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 15:26:29.900691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 15:26:29.900691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 15:26:29.900691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:26:29.900691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:26:29.900691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:26:29.900691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:26:29.900691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 could not be found. (HTTP 404) (Request-ID: req-9ca7bd3e-c84c-4b3d-ac31-7ceede5c5100) Jul 15 15:26:29.900691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:26:29.900691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:26:29.900691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:26:29.901645 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:26:29.901645 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 15 15:26:29.901645 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 15 15:26:29.901645 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 15:26:29.901645 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 15:26:29.901645 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 15:26:29.901645 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 15:26:29.901645 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 15:26:29.901645 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 15:26:29.901645 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 15:26:29.901645 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 15:26:29.901645 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 15:26:29.901645 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 15:26:29.901645 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 15:26:29.901645 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 15:26:29.901645 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 15:26:29.901645 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 15:26:29.901645 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 15:26:29.901645 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 15:26:29.903042 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:26:29.903042 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:26:29.903042 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:26:29.903042 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:26:29.903042 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 could not be found. Jul 15 15:26:29.903042 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:26:29.903042 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:26:29.903042 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:26:29.903042 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:26:29.903042 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:26:29.903042 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:26:29.903042 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:26:29.903042 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:26:29.903042 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 15:26:29.903042 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 15:26:29.903042 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:26:29.903042 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:26:29.903042 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 15 15:26:29.903042 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:26:29.905163 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 could not be found. Jul 15 15:26:29.905163 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:26:29.905163 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:26:29.905163 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:26:29.905163 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:26:29.905163 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:26:29.905163 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:26:29.905163 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:26:29.905163 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:26:29.905163 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 could not be found. Jul 15 15:26:29.905163 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:26:29.905163 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-581bb32b-256b-4a12-9fb9-69aed97031a1 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Returning 404 to user: Volume f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 could not be found. {{(pid=117999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:26:29.905163 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-581bb32b-256b-4a12-9fb9-69aed97031a1 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/f6e2c6f7-d8b0-4d28-86db-ad61ded95e50" status: 404 len: 109 microversion: 2.1 time: 0.139445 Jul 15 15:26:29.922025 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-812a8ced-439d-44ac-b0a7-0937939457d0 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Calling method '.version_select at 0x7fe3c7d61d30>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:29.924773 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 22/38] 10.222.0.40 () {58 vars in 1244 bytes} [Fri Jul 15 15:26:29 2022] GET /compute/v2.1/os-volumes/f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 => generated 109 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:26:30.015320 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-812a8ced-439d-44ac-b0a7-0937939457d0 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] HTTP exception thrown: Volume f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 could not be found. Jul 15 15:26:30.017631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-812a8ced-439d-44ac-b0a7-0937939457d0 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Request method failure captured: Jul 15 15:26:30.017631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: DELETE /compute/v2.1/os-volumes/f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 HTTP/1.1 Jul 15 15:26:30.017631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:26:30.017631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:26:30.017631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:26:30.017631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 15 15:26:30.017631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:26:30.017631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:26:30.017631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:26:30.017631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:26:30.017631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0YcRrP96DtrYsHEkaIUWdaEfCwg7vQEeIqR5HWvD6Y_yuc-EiShTY1huFm9t7Cmq8OY2fG2CKw-z0pDR93fgqjlx-rZ3pyv2hGDGbhYE_IdtQgA4VLSQEsLzM7E64vNwe73mGefZGAGI8P2m0rJGfTUI8ZD6Tr7AnnGUr00cJYXtITw Jul 15 15:26:30.017631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:26:30.017631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:26:30.017631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:26:30.017631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:26:30.017631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:26:30.017631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:26:30.017631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: 1b2864575fba44f29d22c7afb207a73b Jul 15 15:26:30.017631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2031113326 Jul 15 15:26:30.017631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:26:30.017631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:26:30.018754 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1b2864575fba44f29d22c7afb207a73b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1b2864575fba44f29d22c7afb207a73b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1b2864575fba44f29d22c7afb207a73b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1b2864575fba44f29d22c7afb207a73b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:26:30.018754 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2031113326 Jul 15 15:26:30.018754 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 1b2864575fba44f29d22c7afb207a73b Jul 15 15:26:30.018754 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2031113326 Jul 15 15:26:30.018754 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-VolumesSnapshotsTestJSON-2031113326-project Jul 15 15:26:30.018754 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:26:30.018754 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:26:30.018754 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: 5e6af511fedd4788b1b771db772251f3 Jul 15 15:26:30.018754 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2031113326-project Jul 15 15:26:30.018754 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: Jul 15 15:26:30.018754 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Volume f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 could not be found. Jul 15 15:26:30.018754 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'id': 'f6e2c6f7-d8b0-4d28-86db-ad61ded95e50'} Jul 15 15:26:30.018754 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:26:30.019434 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:26:30.019434 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 15:26:30.019434 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 15:26:30.019434 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 15:26:30.019434 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 15:26:30.019434 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 15:26:30.019434 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 15:26:30.019434 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 15:26:30.019434 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 15:26:30.019434 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 15:26:30.019434 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 15:26:30.019434 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:26:30.019434 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:26:30.019434 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:26:30.019434 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:26:30.019434 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 could not be found. (HTTP 404) (Request-ID: req-9a8126f8-2502-443b-9bb4-2be082d1ae37) Jul 15 15:26:30.019434 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:26:30.019434 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:26:30.019434 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:26:30.020492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:26:30.020492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 15 15:26:30.020492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 15 15:26:30.020492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 15:26:30.020492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 15:26:30.020492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 15:26:30.020492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 15:26:30.020492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 15:26:30.020492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 15:26:30.020492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 15:26:30.020492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 15:26:30.020492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 15:26:30.020492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 15:26:30.020492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 15:26:30.020492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 15:26:30.020492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 15:26:30.020492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 15:26:30.020492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 15:26:30.020492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 15:26:30.022129 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:26:30.022129 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:26:30.022129 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:26:30.022129 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:26:30.022129 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 could not be found. Jul 15 15:26:30.022129 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:26:30.022129 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:26:30.022129 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:26:30.022129 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:26:30.022129 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:26:30.022129 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:26:30.022129 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:26:30.022129 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:26:30.022129 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 15:26:30.022129 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 15:26:30.022129 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:26:30.022129 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:26:30.022129 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 15 15:26:30.022129 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:26:30.023074 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 could not be found. Jul 15 15:26:30.023074 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:26:30.023074 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:26:30.023074 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:26:30.023074 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:26:30.023074 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:26:30.023074 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:26:30.023074 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:26:30.023074 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:26:30.023074 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 could not be found. Jul 15 15:26:30.023074 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:26:30.025890 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-812a8ced-439d-44ac-b0a7-0937939457d0 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Returning 404 to user: Volume f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:26:30.027290 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-812a8ced-439d-44ac-b0a7-0937939457d0 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/f6e2c6f7-d8b0-4d28-86db-ad61ded95e50" status: 404 len: 109 microversion: 2.1 time: 0.111385 Jul 15 15:26:30.028446 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 17/39] 10.222.0.40 () {58 vars in 1247 bytes} [Fri Jul 15 15:26:29 2022] DELETE /compute/v2.1/os-volumes/f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:26:30.037437 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-c7e88d64-5a72-438a-8376-fe597e747179 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Calling method '.version_select at 0x7fe3c7da5430>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:30.127571 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.wsgi [None req-c7e88d64-5a72-438a-8376-fe597e747179 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] HTTP exception thrown: Volume f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 could not be found. Jul 15 15:26:30.132604 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-c7e88d64-5a72-438a-8376-fe597e747179 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Request method failure captured: Jul 15 15:26:30.132604 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: request: GET /compute/v2.1/os-volumes/f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 HTTP/1.1 Jul 15 15:26:30.132604 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept: application/json Jul 15 15:26:30.132604 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept-Encoding: identity Jul 15 15:26:30.132604 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Connection: close Jul 15 15:26:30.132604 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Length: 0 Jul 15 15:26:30.132604 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Type: application/json Jul 15 15:26:30.132604 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Host: 10.222.0.40 Jul 15 15:26:30.132604 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Openstack-System-Scope: None Jul 15 15:26:30.132604 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: User-Agent: python-urllib3/1.26.9 Jul 15 15:26:30.132604 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Auth-Token: gAAAAABi0YcRrP96DtrYsHEkaIUWdaEfCwg7vQEeIqR5HWvD6Y_yuc-EiShTY1huFm9t7Cmq8OY2fG2CKw-z0pDR93fgqjlx-rZ3pyv2hGDGbhYE_IdtQgA4VLSQEsLzM7E64vNwe73mGefZGAGI8P2m0rJGfTUI8ZD6Tr7AnnGUr00cJYXtITw Jul 15 15:26:30.132604 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Id: None Jul 15 15:26:30.132604 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Name: None Jul 15 15:26:30.132604 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Identity-Status: Confirmed Jul 15 15:26:30.132604 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Is-Admin-Project: True Jul 15 15:26:30.132604 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Id: default Jul 15 15:26:30.132604 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Name: Default Jul 15 15:26:30.132604 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Id: 1b2864575fba44f29d22c7afb207a73b Jul 15 15:26:30.132604 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2031113326 Jul 15 15:26:30.132604 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Role: member,reader Jul 15 15:26:30.132604 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Roles: member,reader Jul 15 15:26:30.133985 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1b2864575fba44f29d22c7afb207a73b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1b2864575fba44f29d22c7afb207a73b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1b2864575fba44f29d22c7afb207a73b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1b2864575fba44f29d22c7afb207a73b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:26:30.133985 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2031113326 Jul 15 15:26:30.133985 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Id: 1b2864575fba44f29d22c7afb207a73b Jul 15 15:26:30.133985 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2031113326 Jul 15 15:26:30.133985 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User: tempest-VolumesSnapshotsTestJSON-2031113326-project Jul 15 15:26:30.133985 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Id: default Jul 15 15:26:30.133985 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Name: Default Jul 15 15:26:30.133985 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Id: 5e6af511fedd4788b1b771db772251f3 Jul 15 15:26:30.133985 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2031113326-project Jul 15 15:26:30.133985 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: method: Jul 15 15:26:30.133985 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: exception: Volume f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 could not be found. Jul 15 15:26:30.133985 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: action_args: {'id': 'f6e2c6f7-d8b0-4d28-86db-ad61ded95e50'} Jul 15 15:26:30.133985 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:26:30.138179 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:26:30.138179 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 15:26:30.138179 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 15:26:30.138179 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 15:26:30.138179 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 15:26:30.138179 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 15:26:30.138179 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 15:26:30.138179 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 15:26:30.138179 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 15:26:30.138179 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 15:26:30.138179 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 15:26:30.138179 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:26:30.138179 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:26:30.138179 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:26:30.138179 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:26:30.138179 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 could not be found. (HTTP 404) (Request-ID: req-99d7cc64-a4f8-4f36-9c05-1800b89ffcff) Jul 15 15:26:30.138179 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:26:30.138179 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:26:30.138179 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:26:30.139575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:26:30.139575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 15 15:26:30.139575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 15 15:26:30.139575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 15:26:30.139575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 15:26:30.139575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 15:26:30.139575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 15:26:30.139575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 15:26:30.139575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 15:26:30.139575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 15:26:30.139575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 15:26:30.139575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 15:26:30.139575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 15:26:30.139575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 15:26:30.139575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 15:26:30.139575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 15:26:30.139575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 15:26:30.139575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 15:26:30.139575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 15:26:30.140796 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:26:30.140796 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:26:30.140796 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:26:30.140796 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:26:30.140796 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 could not be found. Jul 15 15:26:30.140796 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:26:30.140796 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:26:30.140796 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:26:30.140796 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:26:30.140796 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:26:30.140796 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:26:30.140796 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:26:30.140796 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:26:30.140796 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 15:26:30.140796 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 15:26:30.140796 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:26:30.140796 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:26:30.140796 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 15 15:26:30.140796 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:26:30.142219 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 could not be found. Jul 15 15:26:30.142219 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:26:30.142219 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:26:30.142219 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:26:30.142219 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:26:30.142219 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:26:30.142219 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:26:30.142219 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:26:30.142219 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:26:30.142219 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 could not be found. Jul 15 15:26:30.142219 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:26:30.142219 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-c7e88d64-5a72-438a-8376-fe597e747179 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] Returning 404 to user: Volume f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 could not be found. {{(pid=117999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:26:30.142219 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-c7e88d64-5a72-438a-8376-fe597e747179 tempest-VolumesSnapshotsTestJSON-2031113326 tempest-VolumesSnapshotsTestJSON-2031113326-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/f6e2c6f7-d8b0-4d28-86db-ad61ded95e50" status: 404 len: 109 microversion: 2.1 time: 0.101766 Jul 15 15:26:30.142219 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 23/40] 10.222.0.40 () {58 vars in 1244 bytes} [Fri Jul 15 15:26:30 2022] GET /compute/v2.1/os-volumes/f6e2c6f7-d8b0-4d28-86db-ad61ded95e50 => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:26:30.424689 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f5105010-8b74-4382-abe9-c9fd22887422 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:30.425313 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f5105010-8b74-4382-abe9-c9fd22887422 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:26:30.684334 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f5105010-8b74-4382-abe9-c9fd22887422 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:30.752874 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f5105010-8b74-4382-abe9-c9fd22887422 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:30.760101 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f5105010-8b74-4382-abe9-c9fd22887422 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:30.761286 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f5105010-8b74-4382-abe9-c9fd22887422 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1280 microversion: 2.20 time: 0.340781 Jul 15 15:26:30.771234 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 18/41] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:26:30 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1280 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:26:31.792449 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-7071ede7-33d5-4bc5-a1fa-26088a046b07 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:31.795004 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-7071ede7-33d5-4bc5-a1fa-26088a046b07 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:26:31.955130 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-7071ede7-33d5-4bc5-a1fa-26088a046b07 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:31.970490 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-7071ede7-33d5-4bc5-a1fa-26088a046b07 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:31.986891 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-7071ede7-33d5-4bc5-a1fa-26088a046b07 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:31.989310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-7071ede7-33d5-4bc5-a1fa-26088a046b07 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1280 microversion: 2.20 time: 0.202282 Jul 15 15:26:31.990823 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 24/42] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:26:31 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1280 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:26:33.009696 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7ee41b16-266c-4a0f-a622-c298069344b5 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:33.010375 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7ee41b16-266c-4a0f-a622-c298069344b5 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:26:33.026256 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7ee41b16-266c-4a0f-a622-c298069344b5 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:33.027450 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7ee41b16-266c-4a0f-a622-c298069344b5 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:33.030016 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7ee41b16-266c-4a0f-a622-c298069344b5 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:33.034358 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7ee41b16-266c-4a0f-a622-c298069344b5 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:33.665196 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7ee41b16-266c-4a0f-a622-c298069344b5 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:33.729619 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7ee41b16-266c-4a0f-a622-c298069344b5 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:33.735174 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7ee41b16-266c-4a0f-a622-c298069344b5 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:33.743069 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7ee41b16-266c-4a0f-a622-c298069344b5 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1276 microversion: 2.20 time: 0.737108 Jul 15 15:26:33.748383 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 19/43] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:26:33 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1276 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:26:34.772640 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-ce8dfbe3-552d-4928-96fa-bf5e91e14215 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:34.779535 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-ce8dfbe3-552d-4928-96fa-bf5e91e14215 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:26:34.808639 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ce8dfbe3-552d-4928-96fa-bf5e91e14215 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:34.838488 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ce8dfbe3-552d-4928-96fa-bf5e91e14215 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:34.847928 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ce8dfbe3-552d-4928-96fa-bf5e91e14215 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:34.850015 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ce8dfbe3-552d-4928-96fa-bf5e91e14215 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:35.409748 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-ce8dfbe3-552d-4928-96fa-bf5e91e14215 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:35.493883 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-ce8dfbe3-552d-4928-96fa-bf5e91e14215 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:35.497909 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-ce8dfbe3-552d-4928-96fa-bf5e91e14215 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:35.501945 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-ce8dfbe3-552d-4928-96fa-bf5e91e14215 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1338 microversion: 2.20 time: 0.738486 Jul 15 15:26:35.513044 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 25/44] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:26:34 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1338 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:26:35.515296 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1150c8cb-4e51-4cc7-9b8c-616108fc9cb1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-801775973", "imageRef": "b9770891-ef3b-4f53-a989-3a4db420d5c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "929a0876-8ea0-426c-a25d-7094debddc3d"}], "security_groups": [{"name": "tempest-securitygroup--2045162533"}], "key_name": "tempest-keypair-823981827", "user_data": "}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:26:35.909314 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.network.neutron [None req-1150c8cb-4e51-4cc7-9b8c-616108fc9cb1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] validate_networks() for [('929a0876-8ea0-426c-a25d-7094debddc3d', None, None, None, None, None)] {{(pid=117998) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:26:36.531252 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-1f664aa7-2ac0-456b-b6c1-12942e985d8a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:36.532306 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-1f664aa7-2ac0-456b-b6c1-12942e985d8a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:26:36.559289 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1f664aa7-2ac0-456b-b6c1-12942e985d8a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:36.560059 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1f664aa7-2ac0-456b-b6c1-12942e985d8a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:36.561426 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1f664aa7-2ac0-456b-b6c1-12942e985d8a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:36.562176 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1f664aa7-2ac0-456b-b6c1-12942e985d8a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:36.848180 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1f664aa7-2ac0-456b-b6c1-12942e985d8a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:36.877546 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1f664aa7-2ac0-456b-b6c1-12942e985d8a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:36.881726 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1f664aa7-2ac0-456b-b6c1-12942e985d8a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:36.910790 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-1f664aa7-2ac0-456b-b6c1-12942e985d8a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1338 microversion: 2.20 time: 0.377512 Jul 15 15:26:36.911850 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 26/45] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:26:36 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1338 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:26:37.773406 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-1150c8cb-4e51-4cc7-9b8c-616108fc9cb1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Flavor limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:26:37.774252 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-1150c8cb-4e51-4cc7-9b8c-616108fc9cb1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Image limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:26:37.775070 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-1150c8cb-4e51-4cc7-9b8c-616108fc9cb1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Flavor pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:26:37.775497 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-1150c8cb-4e51-4cc7-9b8c-616108fc9cb1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Image pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:26:37.775910 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-1150c8cb-4e51-4cc7-9b8c-616108fc9cb1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:26:37.791001 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1150c8cb-4e51-4cc7-9b8c-616108fc9cb1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:37.791447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1150c8cb-4e51-4cc7-9b8c-616108fc9cb1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:37.797853 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1150c8cb-4e51-4cc7-9b8c-616108fc9cb1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:37.798858 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1150c8cb-4e51-4cc7-9b8c-616108fc9cb1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:37.827186 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-1150c8cb-4e51-4cc7-9b8c-616108fc9cb1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Getting quotas for project 5e51044e804442909f18288b9a6430a5. Resources: {'ram', 'instances', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:26:37.832461 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-1150c8cb-4e51-4cc7-9b8c-616108fc9cb1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Getting quotas for user 08050c1635084492a4b054b172884af8 and project 5e51044e804442909f18288b9a6430a5. Resources: {'ram', 'instances', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:26:37.848200 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1150c8cb-4e51-4cc7-9b8c-616108fc9cb1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Going to run 1 instances... {{(pid=117998) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:26:37.851085 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1150c8cb-4e51-4cc7-9b8c-616108fc9cb1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9770891-ef3b-4f53-a989-3a4db420d5c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117998) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:26:37.957784 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1150c8cb-4e51-4cc7-9b8c-616108fc9cb1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.442737 Jul 15 15:26:37.957784 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 20/46] 10.222.0.40 () {60 vars in 1146 bytes} [Fri Jul 15 15:26:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 2448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 15:26:37.959852 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-52c5a5b6-9d44-4723-8366-1ad8f5d71ad1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:37.963690 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-52c5a5b6-9d44-4723-8366-1ad8f5d71ad1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:26:38.000924 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-52c5a5b6-9d44-4723-8366-1ad8f5d71ad1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:38.003852 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-52c5a5b6-9d44-4723-8366-1ad8f5d71ad1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:38.005353 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-52c5a5b6-9d44-4723-8366-1ad8f5d71ad1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:38.007561 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-52c5a5b6-9d44-4723-8366-1ad8f5d71ad1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:38.870945 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-74593d1b-3799-4a9e-89b8-266d5489c7f9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1308012739", "imageRef": "b9770891-ef3b-4f53-a989-3a4db420d5c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:26:39.297087 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-52c5a5b6-9d44-4723-8366-1ad8f5d71ad1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:39.330223 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-52c5a5b6-9d44-4723-8366-1ad8f5d71ad1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:39.340517 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-52c5a5b6-9d44-4723-8366-1ad8f5d71ad1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:39.343115 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-52c5a5b6-9d44-4723-8366-1ad8f5d71ad1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1338 microversion: 2.20 time: 1.396463 Jul 15 15:26:39.353527 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 21/47] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:26:37 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1338 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:26:39.379632 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.network.neutron [None req-74593d1b-3799-4a9e-89b8-266d5489c7f9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] validate_networks() for [('ef188e3b-a856-40b3-a6c2-ccce7f5f2933', None, None, None, None, None)] {{(pid=117999) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:26:39.382125 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c26fd227-5b9d-4dfa-a4d4-9c8c55db7af8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:39.391838 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-c26fd227-5b9d-4dfa-a4d4-9c8c55db7af8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:26:39.894100 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c26fd227-5b9d-4dfa-a4d4-9c8c55db7af8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:39.941568 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-c26fd227-5b9d-4dfa-a4d4-9c8c55db7af8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1236 microversion: 2.1 time: 0.580961 Jul 15 15:26:39.944998 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 22/48] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:26:39 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1236 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:26:41.662915 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c04ccef7-e5cb-499b-b8f3-aa15551b86c2 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1897174997", "imageRef": "b9770891-ef3b-4f53-a989-3a4db420d5c5", "flavorRef": "452", "networks": [{"uuid": "5f9f499e-735e-40cb-b307-645e1014d00e"}]}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:26:41.804890 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.network.neutron [None req-c04ccef7-e5cb-499b-b8f3-aa15551b86c2 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] validate_networks() for [('5f9f499e-735e-40cb-b307-645e1014d00e', None, None, None, None, None)] {{(pid=117998) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:26:41.961995 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=8 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:43.492292 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-c04ccef7-e5cb-499b-b8f3-aa15551b86c2 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Flavor limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:26:43.493162 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-c04ccef7-e5cb-499b-b8f3-aa15551b86c2 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Image limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:26:43.494160 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-c04ccef7-e5cb-499b-b8f3-aa15551b86c2 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Flavor pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:26:43.495068 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-c04ccef7-e5cb-499b-b8f3-aa15551b86c2 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Image pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:26:43.495939 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-c04ccef7-e5cb-499b-b8f3-aa15551b86c2 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:26:43.549540 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c04ccef7-e5cb-499b-b8f3-aa15551b86c2 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:43.558573 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c04ccef7-e5cb-499b-b8f3-aa15551b86c2 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:43.558573 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c04ccef7-e5cb-499b-b8f3-aa15551b86c2 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:43.558573 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c04ccef7-e5cb-499b-b8f3-aa15551b86c2 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:43.735088 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-c04ccef7-e5cb-499b-b8f3-aa15551b86c2 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Getting quotas for project f1097bdacbb44067bfa5dbf28bc86d9a. Resources: {'ram', 'instances', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:26:43.771794 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-c04ccef7-e5cb-499b-b8f3-aa15551b86c2 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Getting quotas for user 2a01407bfc0a480a8f6702993ddb0183 and project f1097bdacbb44067bfa5dbf28bc86d9a. Resources: {'ram', 'instances', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:26:43.867899 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-c04ccef7-e5cb-499b-b8f3-aa15551b86c2 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Going to run 1 instances... {{(pid=117998) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:26:43.870239 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-c04ccef7-e5cb-499b-b8f3-aa15551b86c2 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9770891-ef3b-4f53-a989-3a4db420d5c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117998) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:26:44.021582 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-c04ccef7-e5cb-499b-b8f3-aa15551b86c2 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.074444 Jul 15 15:26:44.022893 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 23/49] 10.222.0.40 () {60 vars in 1146 bytes} [Fri Jul 15 15:26:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 4077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 15:26:44.037191 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-976bfc79-681c-4257-ae62-a8219ac663cb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:44.041452 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-976bfc79-681c-4257-ae62-a8219ac663cb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:26:44.082794 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-976bfc79-681c-4257-ae62-a8219ac663cb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:44.083297 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-976bfc79-681c-4257-ae62-a8219ac663cb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:44.084207 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-976bfc79-681c-4257-ae62-a8219ac663cb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:44.084607 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-976bfc79-681c-4257-ae62-a8219ac663cb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:46.096399 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-976bfc79-681c-4257-ae62-a8219ac663cb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:46.172877 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-976bfc79-681c-4257-ae62-a8219ac663cb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:46.198313 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-976bfc79-681c-4257-ae62-a8219ac663cb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:46.212257 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-976bfc79-681c-4257-ae62-a8219ac663cb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 2.186998 Jul 15 15:26:46.221777 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 24/50] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:26:44 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 2198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:26:46.291842 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-bfc4641c-665d-46bb-80da-387de4c04b2b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:46.292948 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-bfc4641c-665d-46bb-80da-387de4c04b2b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:26:46.345432 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bfc4641c-665d-46bb-80da-387de4c04b2b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:46.346305 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bfc4641c-665d-46bb-80da-387de4c04b2b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:46.347787 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bfc4641c-665d-46bb-80da-387de4c04b2b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:46.348671 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bfc4641c-665d-46bb-80da-387de4c04b2b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:46.863248 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-bfc4641c-665d-46bb-80da-387de4c04b2b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:46.873727 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=12 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:46.876447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-bfc4641c-665d-46bb-80da-387de4c04b2b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1294 microversion: 2.1 time: 0.642301 Jul 15 15:26:46.898584 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 25/51] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:26:46 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1294 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:26:46.922764 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-fb550d0d-ca30-4074-97cc-3fb7524b0eeb tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:46.924494 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-fb550d0d-ca30-4074-97cc-3fb7524b0eeb tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:26:46.951869 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fb550d0d-ca30-4074-97cc-3fb7524b0eeb tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:46.959071 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fb550d0d-ca30-4074-97cc-3fb7524b0eeb tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:46.965476 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fb550d0d-ca30-4074-97cc-3fb7524b0eeb tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:46.969911 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fb550d0d-ca30-4074-97cc-3fb7524b0eeb tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:48.172679 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-74593d1b-3799-4a9e-89b8-266d5489c7f9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Flavor limits 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:26:48.173699 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-74593d1b-3799-4a9e-89b8-266d5489c7f9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Image limits 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:26:48.174709 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-74593d1b-3799-4a9e-89b8-266d5489c7f9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Flavor pref 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:26:48.175766 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-74593d1b-3799-4a9e-89b8-266d5489c7f9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Image pref 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:26:48.176760 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-74593d1b-3799-4a9e-89b8-266d5489c7f9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:26:48.204817 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-fb550d0d-ca30-4074-97cc-3fb7524b0eeb tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:48.232794 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-74593d1b-3799-4a9e-89b8-266d5489c7f9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:48.242942 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-fb550d0d-ca30-4074-97cc-3fb7524b0eeb tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1267 microversion: 2.1 time: 1.340731 Jul 15 15:26:48.245152 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 26/52] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:26:46 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1267 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:26:48.254157 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-74593d1b-3799-4a9e-89b8-266d5489c7f9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:48.262315 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-74593d1b-3799-4a9e-89b8-266d5489c7f9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:48.264834 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-74593d1b-3799-4a9e-89b8-266d5489c7f9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:48.388374 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-74593d1b-3799-4a9e-89b8-266d5489c7f9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Getting quotas for project 1e21747a454c4ebebb5d48b5906d5e5c. Resources: {'ram', 'instances', 'cores'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:26:48.403135 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-74593d1b-3799-4a9e-89b8-266d5489c7f9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Getting quotas for user c1a1af21d3f94b70a830b14200619f87 and project 1e21747a454c4ebebb5d48b5906d5e5c. Resources: {'ram', 'instances', 'cores'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:26:48.464107 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-74593d1b-3799-4a9e-89b8-266d5489c7f9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Going to run 1 instances... {{(pid=117999) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:26:48.488750 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-74593d1b-3799-4a9e-89b8-266d5489c7f9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9770891-ef3b-4f53-a989-3a4db420d5c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117999) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:26:48.862414 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-74593d1b-3799-4a9e-89b8-266d5489c7f9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 11.291986 Jul 15 15:26:48.864274 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 27/53] 10.222.0.40 () {60 vars in 1146 bytes} [Fri Jul 15 15:26:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 11296 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 15:26:48.871148 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-8eff8a64-2105-400e-92ca-2ef0b971b290 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:48.886791 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-8eff8a64-2105-400e-92ca-2ef0b971b290 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:26:48.947921 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8eff8a64-2105-400e-92ca-2ef0b971b290 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:48.957310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8eff8a64-2105-400e-92ca-2ef0b971b290 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:48.958509 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8eff8a64-2105-400e-92ca-2ef0b971b290 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:48.964373 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8eff8a64-2105-400e-92ca-2ef0b971b290 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:49.353324 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-6e38c5f6-5428-4199-8f34-b9ae5729cc7c req-09f582a1-5018-4213-b64a-ceb872d7e424 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5180ff6f-38fa-49c2-9663-9269dcae4849", "tag": "03d3bd84-1aa5-4842-b751-250a289b02fe"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:26:49.418153 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-6e38c5f6-5428-4199-8f34-b9ae5729cc7c req-09f582a1-5018-4213-b64a-ceb872d7e424 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:49.424962 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-6e38c5f6-5428-4199-8f34-b9ae5729cc7c req-09f582a1-5018-4213-b64a-ceb872d7e424 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:49.547738 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-6e38c5f6-5428-4199-8f34-b9ae5729cc7c req-09f582a1-5018-4213-b64a-ceb872d7e424 service nova] Creating event network-changed:03d3bd84-1aa5-4842-b751-250a289b02fe for instance 5180ff6f-38fa-49c2-9663-9269dcae4849 on hv-cinder-85001 Jul 15 15:26:49.551569 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-6e38c5f6-5428-4199-8f34-b9ae5729cc7c req-09f582a1-5018-4213-b64a-ceb872d7e424 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117998) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 15 15:26:49.556251 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-84619492-f528-440a-8607-bda43d9b02e8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:49.560224 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-84619492-f528-440a-8607-bda43d9b02e8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:49.565555 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-84619492-f528-440a-8607-bda43d9b02e8 None None] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:49.570320 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-84619492-f528-440a-8607-bda43d9b02e8 None None] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:49.607937 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.compute.rpcapi [None req-84619492-f528-440a-8607-bda43d9b02e8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 15 15:26:49.609873 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-84619492-f528-440a-8607-bda43d9b02e8 None None] Releasing lock "compute-rpcapi-router" {{(pid=117998) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 15 15:26:49.668128 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-84619492-f528-440a-8607-bda43d9b02e8 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.416885 Jul 15 15:26:49.668866 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 27/54] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:26:49.675662 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1477deb8-d9f8-4e83-a624-bbc3bc553607 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:49.680332 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1477deb8-d9f8-4e83-a624-bbc3bc553607 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:26:49.709588 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1477deb8-d9f8-4e83-a624-bbc3bc553607 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:49.717677 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1477deb8-d9f8-4e83-a624-bbc3bc553607 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:49.721621 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1477deb8-d9f8-4e83-a624-bbc3bc553607 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:49.723260 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1477deb8-d9f8-4e83-a624-bbc3bc553607 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:51.789011 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-8eff8a64-2105-400e-92ca-2ef0b971b290 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:51.853409 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-8eff8a64-2105-400e-92ca-2ef0b971b290 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:51.863313 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-8eff8a64-2105-400e-92ca-2ef0b971b290 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:51.864875 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-8eff8a64-2105-400e-92ca-2ef0b971b290 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 2.998403 Jul 15 15:26:51.866071 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 28/55] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:26:48 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 3001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:26:51.880777 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-fbb37059-79ed-46d8-b467-b89903004bd1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:51.883084 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-fbb37059-79ed-46d8-b467-b89903004bd1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:26:51.894902 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=4 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:51.897620 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fbb37059-79ed-46d8-b467-b89903004bd1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:51.899554 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fbb37059-79ed-46d8-b467-b89903004bd1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:51.901197 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fbb37059-79ed-46d8-b467-b89903004bd1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:51.901875 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fbb37059-79ed-46d8-b467-b89903004bd1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:52.174283 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1477deb8-d9f8-4e83-a624-bbc3bc553607 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:52.204753 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=45 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:52.219356 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1477deb8-d9f8-4e83-a624-bbc3bc553607 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 2.548508 Jul 15 15:26:52.239286 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 28/56] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:26:49 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 2565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:26:52.266056 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-dec0c97a-f6e5-4df8-9acf-baaaf21db1e9 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:52.270901 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-dec0c97a-f6e5-4df8-9acf-baaaf21db1e9 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:26:52.278174 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=10 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:52.327486 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dec0c97a-f6e5-4df8-9acf-baaaf21db1e9 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:52.336709 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dec0c97a-f6e5-4df8-9acf-baaaf21db1e9 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:52.339527 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dec0c97a-f6e5-4df8-9acf-baaaf21db1e9 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:52.342387 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dec0c97a-f6e5-4df8-9acf-baaaf21db1e9 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:52.434172 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-fbb37059-79ed-46d8-b467-b89903004bd1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:52.460454 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-fbb37059-79ed-46d8-b467-b89903004bd1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1282 microversion: 2.1 time: 0.592062 Jul 15 15:26:52.461382 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 29/57] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:26:51 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1282 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:26:52.780260 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-7cd4c287-03b1-46d5-a3dd-bba9deb6db09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1632689322", "imageRef": "b9770891-ef3b-4f53-a989-3a4db420d5c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:26:52.944471 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.network.neutron [None req-7cd4c287-03b1-46d5-a3dd-bba9deb6db09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] validate_networks() for [('ef188e3b-a856-40b3-a6c2-ccce7f5f2933', None, None, None, None, None)] {{(pid=117999) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:26:53.834210 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=26 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:53.898068 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-dec0c97a-f6e5-4df8-9acf-baaaf21db1e9 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:53.926801 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-dec0c97a-f6e5-4df8-9acf-baaaf21db1e9 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 1.682197 Jul 15 15:26:53.929036 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 29/58] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:26:52 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:26:53.960858 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-98ac0aed-b85c-4d81-bf15-eb38ec2db8bc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:53.962678 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-98ac0aed-b85c-4d81-bf15-eb38ec2db8bc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:26:53.986191 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-98ac0aed-b85c-4d81-bf15-eb38ec2db8bc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:53.987428 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-98ac0aed-b85c-4d81-bf15-eb38ec2db8bc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:53.992913 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-98ac0aed-b85c-4d81-bf15-eb38ec2db8bc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:53.994099 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-98ac0aed-b85c-4d81-bf15-eb38ec2db8bc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:55.157180 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-7cd4c287-03b1-46d5-a3dd-bba9deb6db09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Flavor limits 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:26:55.158067 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-7cd4c287-03b1-46d5-a3dd-bba9deb6db09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Image limits 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:26:55.158793 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-7cd4c287-03b1-46d5-a3dd-bba9deb6db09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Flavor pref 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:26:55.159835 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-7cd4c287-03b1-46d5-a3dd-bba9deb6db09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Image pref 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:26:55.160723 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-7cd4c287-03b1-46d5-a3dd-bba9deb6db09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:26:55.199294 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7cd4c287-03b1-46d5-a3dd-bba9deb6db09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:55.201622 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7cd4c287-03b1-46d5-a3dd-bba9deb6db09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:55.204555 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7cd4c287-03b1-46d5-a3dd-bba9deb6db09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:55.207600 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7cd4c287-03b1-46d5-a3dd-bba9deb6db09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:55.211502 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-98ac0aed-b85c-4d81-bf15-eb38ec2db8bc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:55.240860 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-98ac0aed-b85c-4d81-bf15-eb38ec2db8bc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:55.259734 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-98ac0aed-b85c-4d81-bf15-eb38ec2db8bc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:55.264370 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-98ac0aed-b85c-4d81-bf15-eb38ec2db8bc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 1.331580 Jul 15 15:26:55.270824 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 30/59] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:26:53 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:26:55.274394 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-7cd4c287-03b1-46d5-a3dd-bba9deb6db09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Getting quotas for project 1e21747a454c4ebebb5d48b5906d5e5c. Resources: {'ram', 'instances', 'cores'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:26:55.287628 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-7cd4c287-03b1-46d5-a3dd-bba9deb6db09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Getting quotas for user c1a1af21d3f94b70a830b14200619f87 and project 1e21747a454c4ebebb5d48b5906d5e5c. Resources: {'ram', 'instances', 'cores'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:26:55.291820 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-327930fa-605f-4c09-894e-a92b8b93188b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:55.292470 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-327930fa-605f-4c09-894e-a92b8b93188b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:26:55.316073 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-327930fa-605f-4c09-894e-a92b8b93188b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:55.316594 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-327930fa-605f-4c09-894e-a92b8b93188b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:55.317606 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-327930fa-605f-4c09-894e-a92b8b93188b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:55.318043 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-327930fa-605f-4c09-894e-a92b8b93188b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:55.339102 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-7cd4c287-03b1-46d5-a3dd-bba9deb6db09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Going to run 1 instances... {{(pid=117999) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:26:55.365585 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-7cd4c287-03b1-46d5-a3dd-bba9deb6db09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9770891-ef3b-4f53-a989-3a4db420d5c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117999) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:26:55.635850 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-7cd4c287-03b1-46d5-a3dd-bba9deb6db09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.860137 Jul 15 15:26:55.638319 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 30/60] 10.222.0.40 () {60 vars in 1146 bytes} [Fri Jul 15 15:26:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 2864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 15 15:26:55.653383 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-30276f7a-abe1-4ab7-a603-a7d10f098ff6 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:55.655130 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-30276f7a-abe1-4ab7-a603-a7d10f098ff6 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:26:55.681845 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-30276f7a-abe1-4ab7-a603-a7d10f098ff6 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:55.683663 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-30276f7a-abe1-4ab7-a603-a7d10f098ff6 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:55.689630 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-30276f7a-abe1-4ab7-a603-a7d10f098ff6 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:55.691334 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-30276f7a-abe1-4ab7-a603-a7d10f098ff6 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:56.631381 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-327930fa-605f-4c09-894e-a92b8b93188b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:56.661972 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-327930fa-605f-4c09-894e-a92b8b93188b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 1.388356 Jul 15 15:26:56.663491 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 31/61] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:26:55 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:26:56.721491 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-803d450b-4a97-4b64-8a4f-4e6124d11aa0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:56.726874 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-803d450b-4a97-4b64-8a4f-4e6124d11aa0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:26:57.264986 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-30276f7a-abe1-4ab7-a603-a7d10f098ff6 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:57.292362 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-30276f7a-abe1-4ab7-a603-a7d10f098ff6 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 1.651429 Jul 15 15:26:57.317287 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 31/62] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:26:55 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:26:57.328062 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-a982b369-15bf-4597-bf6d-9b5d1f5732e9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:57.329768 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-a982b369-15bf-4597-bf6d-9b5d1f5732e9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:26:57.373253 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a982b369-15bf-4597-bf6d-9b5d1f5732e9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:57.374262 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a982b369-15bf-4597-bf6d-9b5d1f5732e9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:57.377751 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a982b369-15bf-4597-bf6d-9b5d1f5732e9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:57.381133 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a982b369-15bf-4597-bf6d-9b5d1f5732e9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:57.425284 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-803d450b-4a97-4b64-8a4f-4e6124d11aa0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:57.452073 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-803d450b-4a97-4b64-8a4f-4e6124d11aa0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1222 microversion: 2.1 time: 0.764103 Jul 15 15:26:57.455337 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 32/63] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:26:56 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1222 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:26:57.477557 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-c581e6ea-03cb-45da-b105-358d3fc664d5 req-ce090a57-40eb-45d1-a104-f9abc9713eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59fc0e3c-5238-40d8-a589-60ceb542cf30", "tag": "41019c37-3597-4667-9423-efc3b2c8ab76"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:26:57.511269 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-c581e6ea-03cb-45da-b105-358d3fc664d5 req-ce090a57-40eb-45d1-a104-f9abc9713eb2 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:57.513609 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-c581e6ea-03cb-45da-b105-358d3fc664d5 req-ce090a57-40eb-45d1-a104-f9abc9713eb2 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:57.547466 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-c581e6ea-03cb-45da-b105-358d3fc664d5 req-ce090a57-40eb-45d1-a104-f9abc9713eb2 service nova] Creating event network-changed:41019c37-3597-4667-9423-efc3b2c8ab76 for instance 59fc0e3c-5238-40d8-a589-60ceb542cf30 on hv-cinder-85001 Jul 15 15:26:57.565283 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-c581e6ea-03cb-45da-b105-358d3fc664d5 req-ce090a57-40eb-45d1-a104-f9abc9713eb2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106978 Jul 15 15:26:57.575904 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 33/64] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:26:57.717328 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2522bf0f-9843-4448-9972-65da70e1dd03 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:57.722446 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-2522bf0f-9843-4448-9972-65da70e1dd03 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:26:57.772957 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2522bf0f-9843-4448-9972-65da70e1dd03 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:57.773732 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2522bf0f-9843-4448-9972-65da70e1dd03 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:57.775513 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2522bf0f-9843-4448-9972-65da70e1dd03 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:57.776129 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2522bf0f-9843-4448-9972-65da70e1dd03 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:58.695098 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-a982b369-15bf-4597-bf6d-9b5d1f5732e9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:58.708119 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-a982b369-15bf-4597-bf6d-9b5d1f5732e9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:58.711367 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-a982b369-15bf-4597-bf6d-9b5d1f5732e9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:58.713502 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-a982b369-15bf-4597-bf6d-9b5d1f5732e9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 1.394084 Jul 15 15:26:58.731328 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 32/65] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:26:57 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:26:58.747241 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-a6b18418-3ed4-4639-9416-3ae3081fb36b tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:58.748955 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-a6b18418-3ed4-4639-9416-3ae3081fb36b tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:26:58.760819 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a6b18418-3ed4-4639-9416-3ae3081fb36b tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:58.762282 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a6b18418-3ed4-4639-9416-3ae3081fb36b tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:58.764438 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a6b18418-3ed4-4639-9416-3ae3081fb36b tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:58.765650 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a6b18418-3ed4-4639-9416-3ae3081fb36b tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:58.782966 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2522bf0f-9843-4448-9972-65da70e1dd03 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:58.798818 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-2522bf0f-9843-4448-9972-65da70e1dd03 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 1.102502 Jul 15 15:26:58.799742 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 34/66] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:26:57 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:26:59.016914 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-a6b18418-3ed4-4639-9416-3ae3081fb36b tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:59.044879 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-a6b18418-3ed4-4639-9416-3ae3081fb36b tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.311771 Jul 15 15:26:59.046220 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 33/67] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:26:58 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:26:59.059363 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-e2e9b289-1dc4-47e2-b942-e9083e95b654 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:59.064420 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-e2e9b289-1dc4-47e2-b942-e9083e95b654 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:26:59.081167 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e2e9b289-1dc4-47e2-b942-e9083e95b654 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:59.082401 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e2e9b289-1dc4-47e2-b942-e9083e95b654 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:59.089531 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e2e9b289-1dc4-47e2-b942-e9083e95b654 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:59.090342 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e2e9b289-1dc4-47e2-b942-e9083e95b654 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:59.118879 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-4bc0565a-1c99-48f5-a6a4-2066f94b0ba3 req-796b347a-dcb5-4884-b95f-ff79b5030f05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d95c0294-3423-429b-8bcf-43e2089fca23", "tag": "342c12f2-654f-4608-be83-59dbef84ae43"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:26:59.137010 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-4bc0565a-1c99-48f5-a6a4-2066f94b0ba3 req-796b347a-dcb5-4884-b95f-ff79b5030f05 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:59.138009 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-4bc0565a-1c99-48f5-a6a4-2066f94b0ba3 req-796b347a-dcb5-4884-b95f-ff79b5030f05 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:59.158669 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-4bc0565a-1c99-48f5-a6a4-2066f94b0ba3 req-796b347a-dcb5-4884-b95f-ff79b5030f05 service nova] Creating event network-changed:342c12f2-654f-4608-be83-59dbef84ae43 for instance d95c0294-3423-429b-8bcf-43e2089fca23 on hv-cinder-85001 Jul 15 15:26:59.170069 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-4bc0565a-1c99-48f5-a6a4-2066f94b0ba3 req-796b347a-dcb5-4884-b95f-ff79b5030f05 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.356853 Jul 15 15:26:59.172428 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 35/68] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:26:59.250497 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e2e9b289-1dc4-47e2-b942-e9083e95b654 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:26:59.263915 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-e2e9b289-1dc4-47e2-b942-e9083e95b654 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1274 microversion: 2.1 time: 0.214497 Jul 15 15:26:59.265039 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 34/69] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:26:59 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1274 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:26:59.734770 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=8 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:26:59.740172 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-fb5d9082-35b7-410d-a716-5ecf668bc358 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:59.741052 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-fb5d9082-35b7-410d-a716-5ecf668bc358 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:26:59.754960 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fb5d9082-35b7-410d-a716-5ecf668bc358 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:59.755933 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fb5d9082-35b7-410d-a716-5ecf668bc358 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:59.756947 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fb5d9082-35b7-410d-a716-5ecf668bc358 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:59.757375 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fb5d9082-35b7-410d-a716-5ecf668bc358 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:59.843844 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-6774b099-4497-4b41-9627-564f7dc9b52e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:26:59.845804 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-6774b099-4497-4b41-9627-564f7dc9b52e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:26:59.857968 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6774b099-4497-4b41-9627-564f7dc9b52e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:59.860070 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6774b099-4497-4b41-9627-564f7dc9b52e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:26:59.861698 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6774b099-4497-4b41-9627-564f7dc9b52e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:26:59.862744 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6774b099-4497-4b41-9627-564f7dc9b52e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:00.191117 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6774b099-4497-4b41-9627-564f7dc9b52e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:00.207442 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-6774b099-4497-4b41-9627-564f7dc9b52e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.370079 Jul 15 15:27:00.216074 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 35/70] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:26:59 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:00.234749 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-09282441-d0db-4f7e-9bdf-945e31f4ddc2 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:00.235802 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-09282441-d0db-4f7e-9bdf-945e31f4ddc2 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:00.259252 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-09282441-d0db-4f7e-9bdf-945e31f4ddc2 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:00.259992 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-09282441-d0db-4f7e-9bdf-945e31f4ddc2 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:00.261310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-09282441-d0db-4f7e-9bdf-945e31f4ddc2 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:00.270131 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-09282441-d0db-4f7e-9bdf-945e31f4ddc2 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:00.338095 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-fb5d9082-35b7-410d-a716-5ecf668bc358 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:00.443620 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-fb5d9082-35b7-410d-a716-5ecf668bc358 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:00.443620 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-fb5d9082-35b7-410d-a716-5ecf668bc358 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:00.450573 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-fb5d9082-35b7-410d-a716-5ecf668bc358 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.716597 Jul 15 15:27:00.458651 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 36/71] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:26:59 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:27:00.467082 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-39fb8c59-2839-4338-906b-a42fa409c28f tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:00.468003 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-39fb8c59-2839-4338-906b-a42fa409c28f tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:00.492828 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-39fb8c59-2839-4338-906b-a42fa409c28f tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:00.493706 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-39fb8c59-2839-4338-906b-a42fa409c28f tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:00.495001 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-39fb8c59-2839-4338-906b-a42fa409c28f tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:00.495747 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-39fb8c59-2839-4338-906b-a42fa409c28f tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:00.793842 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-39fb8c59-2839-4338-906b-a42fa409c28f tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:00.810081 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-39fb8c59-2839-4338-906b-a42fa409c28f tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1274 microversion: 2.1 time: 0.349873 Jul 15 15:27:00.817854 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 37/72] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:00 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1274 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:00.829149 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-600d339e-071f-4091-aef0-d7ec1497b2fd req-d8bcc4fa-d7f0-488e-a532-43bf7e5aed85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "021070dd-3943-48b0-a90a-b889e49029ae", "tag": "8eaeb63d-dfdc-41da-99f1-1ca36ce2f20f"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:27:00.865720 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-600d339e-071f-4091-aef0-d7ec1497b2fd req-d8bcc4fa-d7f0-488e-a532-43bf7e5aed85 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:00.866562 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-600d339e-071f-4091-aef0-d7ec1497b2fd req-d8bcc4fa-d7f0-488e-a532-43bf7e5aed85 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:00.903388 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-600d339e-071f-4091-aef0-d7ec1497b2fd req-d8bcc4fa-d7f0-488e-a532-43bf7e5aed85 service nova] Creating event network-changed:8eaeb63d-dfdc-41da-99f1-1ca36ce2f20f for instance 021070dd-3943-48b0-a90a-b889e49029ae on hv-cinder-85001 Jul 15 15:27:00.909366 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-600d339e-071f-4091-aef0-d7ec1497b2fd req-d8bcc4fa-d7f0-488e-a532-43bf7e5aed85 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090015 Jul 15 15:27:00.911986 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 38/73] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:27:00.988258 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-09282441-d0db-4f7e-9bdf-945e31f4ddc2 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:01.006187 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-09282441-d0db-4f7e-9bdf-945e31f4ddc2 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.788176 Jul 15 15:27:01.010705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 36/74] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:00 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:01.246194 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-cda6568a-96eb-4bc3-80f8-74afc0e7e30c tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:01.248757 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-cda6568a-96eb-4bc3-80f8-74afc0e7e30c tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:01.264842 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cda6568a-96eb-4bc3-80f8-74afc0e7e30c tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:01.267271 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cda6568a-96eb-4bc3-80f8-74afc0e7e30c tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:01.269778 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cda6568a-96eb-4bc3-80f8-74afc0e7e30c tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:01.271145 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cda6568a-96eb-4bc3-80f8-74afc0e7e30c tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:01.474011 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-f6684ffd-52e2-4dd4-a097-e7f5ee907f2d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:01.475284 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-f6684ffd-52e2-4dd4-a097-e7f5ee907f2d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:01.488099 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f6684ffd-52e2-4dd4-a097-e7f5ee907f2d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:01.488923 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f6684ffd-52e2-4dd4-a097-e7f5ee907f2d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:01.490226 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f6684ffd-52e2-4dd4-a097-e7f5ee907f2d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:01.490938 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f6684ffd-52e2-4dd4-a097-e7f5ee907f2d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:01.777068 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-cda6568a-96eb-4bc3-80f8-74afc0e7e30c tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:01.796580 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-cda6568a-96eb-4bc3-80f8-74afc0e7e30c tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.563432 Jul 15 15:27:01.797589 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 39/75] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:01 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:27:01.843310 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7f4767ea-84f7-404a-9fbc-061746d41903 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:01.844577 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7f4767ea-84f7-404a-9fbc-061746d41903 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:01.858226 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7f4767ea-84f7-404a-9fbc-061746d41903 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:01.859860 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7f4767ea-84f7-404a-9fbc-061746d41903 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:01.861913 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7f4767ea-84f7-404a-9fbc-061746d41903 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:01.862872 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7f4767ea-84f7-404a-9fbc-061746d41903 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:01.888602 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f6684ffd-52e2-4dd4-a097-e7f5ee907f2d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:01.914782 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f6684ffd-52e2-4dd4-a097-e7f5ee907f2d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:01.916295 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f6684ffd-52e2-4dd4-a097-e7f5ee907f2d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:01.917436 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-f6684ffd-52e2-4dd4-a097-e7f5ee907f2d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.450822 Jul 15 15:27:01.929789 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 37/76] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:01 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:27:02.005657 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7f4767ea-84f7-404a-9fbc-061746d41903 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:02.022105 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7f4767ea-84f7-404a-9fbc-061746d41903 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1274 microversion: 2.1 time: 0.184299 Jul 15 15:27:02.023601 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 40/77] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:01 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1274 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:27:02.048367 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-481b3c63-4616-4cde-a916-96dd7f288603 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:02.049739 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-481b3c63-4616-4cde-a916-96dd7f288603 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:02.061056 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-481b3c63-4616-4cde-a916-96dd7f288603 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:02.061623 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-481b3c63-4616-4cde-a916-96dd7f288603 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:02.062601 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-481b3c63-4616-4cde-a916-96dd7f288603 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:02.063675 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-481b3c63-4616-4cde-a916-96dd7f288603 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:02.323348 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-481b3c63-4616-4cde-a916-96dd7f288603 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:02.348024 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-481b3c63-4616-4cde-a916-96dd7f288603 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.306891 Jul 15 15:27:02.353938 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 38/78] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:02 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:02.825511 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1c34a08c-8068-411b-a533-4bce8c9e72f1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:02.826821 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1c34a08c-8068-411b-a533-4bce8c9e72f1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:02.839588 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1c34a08c-8068-411b-a533-4bce8c9e72f1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:02.840956 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1c34a08c-8068-411b-a533-4bce8c9e72f1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:02.842207 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1c34a08c-8068-411b-a533-4bce8c9e72f1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:02.843080 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1c34a08c-8068-411b-a533-4bce8c9e72f1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:02.942977 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-7216b49b-1198-44c1-bc2c-dff8bcb4db9c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:02.945945 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-7216b49b-1198-44c1-bc2c-dff8bcb4db9c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:02.969323 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7216b49b-1198-44c1-bc2c-dff8bcb4db9c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:02.970512 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7216b49b-1198-44c1-bc2c-dff8bcb4db9c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:02.976079 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7216b49b-1198-44c1-bc2c-dff8bcb4db9c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:02.977137 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7216b49b-1198-44c1-bc2c-dff8bcb4db9c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:03.252513 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1c34a08c-8068-411b-a533-4bce8c9e72f1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:03.272020 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1c34a08c-8068-411b-a533-4bce8c9e72f1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.452535 Jul 15 15:27:03.287558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 41/79] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:02 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:03.300429 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e8bb76f3-cce0-4395-af4b-9605cb134582 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:03.306799 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e8bb76f3-cce0-4395-af4b-9605cb134582 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:03.324232 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e8bb76f3-cce0-4395-af4b-9605cb134582 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:03.327265 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e8bb76f3-cce0-4395-af4b-9605cb134582 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:03.332884 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e8bb76f3-cce0-4395-af4b-9605cb134582 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:03.333991 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e8bb76f3-cce0-4395-af4b-9605cb134582 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:03.355806 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-7216b49b-1198-44c1-bc2c-dff8bcb4db9c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:03.386551 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-7216b49b-1198-44c1-bc2c-dff8bcb4db9c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:03.394064 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-7216b49b-1198-44c1-bc2c-dff8bcb4db9c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:03.399072 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-7216b49b-1198-44c1-bc2c-dff8bcb4db9c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.462460 Jul 15 15:27:03.401902 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 39/80] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:02 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:27:03.412705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3e34ff82-3e5a-4844-b4b2-d67f427ba359 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:03.414821 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-3e34ff82-3e5a-4844-b4b2-d67f427ba359 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:03.431775 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3e34ff82-3e5a-4844-b4b2-d67f427ba359 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:03.433658 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3e34ff82-3e5a-4844-b4b2-d67f427ba359 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:03.435382 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3e34ff82-3e5a-4844-b4b2-d67f427ba359 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:03.436449 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3e34ff82-3e5a-4844-b4b2-d67f427ba359 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:03.506420 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e8bb76f3-cce0-4395-af4b-9605cb134582 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:03.533695 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e8bb76f3-cce0-4395-af4b-9605cb134582 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1274 microversion: 2.1 time: 0.243330 Jul 15 15:27:03.535326 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 42/81] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:03 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1274 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:03.721816 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3e34ff82-3e5a-4844-b4b2-d67f427ba359 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:03.734862 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-3e34ff82-3e5a-4844-b4b2-d67f427ba359 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.329350 Jul 15 15:27:03.736763 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 40/82] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:03 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:04.296823 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5e0ef76b-90cd-4fbe-9769-3806d4943011 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:04.298102 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5e0ef76b-90cd-4fbe-9769-3806d4943011 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:04.309698 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5e0ef76b-90cd-4fbe-9769-3806d4943011 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:04.310156 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5e0ef76b-90cd-4fbe-9769-3806d4943011 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:04.310976 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5e0ef76b-90cd-4fbe-9769-3806d4943011 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:04.311552 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5e0ef76b-90cd-4fbe-9769-3806d4943011 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:04.423257 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-8f8d897b-6036-412c-bddf-646fc351180a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:04.425067 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-8f8d897b-6036-412c-bddf-646fc351180a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:04.433124 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8f8d897b-6036-412c-bddf-646fc351180a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:04.433894 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8f8d897b-6036-412c-bddf-646fc351180a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:04.435909 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8f8d897b-6036-412c-bddf-646fc351180a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:04.436992 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8f8d897b-6036-412c-bddf-646fc351180a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:04.780577 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5e0ef76b-90cd-4fbe-9769-3806d4943011 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:04.798643 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5e0ef76b-90cd-4fbe-9769-3806d4943011 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.509297 Jul 15 15:27:04.801329 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 43/83] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:04 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:04.807278 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-62b1e0df-e71a-434c-909b-55e80dac505b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:04.808701 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-62b1e0df-e71a-434c-909b-55e80dac505b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:04.820017 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-62b1e0df-e71a-434c-909b-55e80dac505b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:04.820864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-62b1e0df-e71a-434c-909b-55e80dac505b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:04.822637 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-62b1e0df-e71a-434c-909b-55e80dac505b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:04.823348 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-62b1e0df-e71a-434c-909b-55e80dac505b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:04.855232 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-8f8d897b-6036-412c-bddf-646fc351180a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:04.867960 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-8f8d897b-6036-412c-bddf-646fc351180a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:04.870350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-8f8d897b-6036-412c-bddf-646fc351180a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:04.876484 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-8f8d897b-6036-412c-bddf-646fc351180a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.454963 Jul 15 15:27:04.895906 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 41/84] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:04 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:27:04.917824 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-885a1c06-7755-436b-a590-688e5e26f33f tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:04.918879 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-885a1c06-7755-436b-a590-688e5e26f33f tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:04.940390 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-885a1c06-7755-436b-a590-688e5e26f33f tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:04.941354 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-885a1c06-7755-436b-a590-688e5e26f33f tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:04.942612 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-885a1c06-7755-436b-a590-688e5e26f33f tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:04.943522 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-885a1c06-7755-436b-a590-688e5e26f33f tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:05.017992 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-62b1e0df-e71a-434c-909b-55e80dac505b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:05.032704 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-62b1e0df-e71a-434c-909b-55e80dac505b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1274 microversion: 2.1 time: 0.229755 Jul 15 15:27:05.036569 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 44/85] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:04 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1274 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:05.246987 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=4 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:05.330040 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=12 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:05.837935 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9724c477-f4d3-4256-b0eb-a0c13172b5e8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:05.839073 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9724c477-f4d3-4256-b0eb-a0c13172b5e8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:05.868374 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9724c477-f4d3-4256-b0eb-a0c13172b5e8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:05.872653 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9724c477-f4d3-4256-b0eb-a0c13172b5e8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:05.873948 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9724c477-f4d3-4256-b0eb-a0c13172b5e8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:05.890677 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9724c477-f4d3-4256-b0eb-a0c13172b5e8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:06.448990 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-885a1c06-7755-436b-a590-688e5e26f33f tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:06.474720 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-885a1c06-7755-436b-a590-688e5e26f33f tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 1.574981 Jul 15 15:27:06.480947 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 42/86] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:04 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:06.505241 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-77ff9c99-601b-48e8-b85e-efe1cbf94b0a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:06.507830 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-77ff9c99-601b-48e8-b85e-efe1cbf94b0a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:06.548358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-77ff9c99-601b-48e8-b85e-efe1cbf94b0a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:06.550813 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-77ff9c99-601b-48e8-b85e-efe1cbf94b0a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:06.561350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-77ff9c99-601b-48e8-b85e-efe1cbf94b0a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:06.565373 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-77ff9c99-601b-48e8-b85e-efe1cbf94b0a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:07.053087 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9724c477-f4d3-4256-b0eb-a0c13172b5e8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:07.091235 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9724c477-f4d3-4256-b0eb-a0c13172b5e8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 1.260149 Jul 15 15:27:07.094317 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 45/87] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:05 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:27:07.110006 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-828b695f-d644-44e9-a64a-63038625eaad tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:07.111584 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-828b695f-d644-44e9-a64a-63038625eaad tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:07.122230 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-828b695f-d644-44e9-a64a-63038625eaad tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:07.123278 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-828b695f-d644-44e9-a64a-63038625eaad tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:07.124807 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-828b695f-d644-44e9-a64a-63038625eaad tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:07.125875 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-828b695f-d644-44e9-a64a-63038625eaad tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:07.147236 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-77ff9c99-601b-48e8-b85e-efe1cbf94b0a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:07.179682 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-77ff9c99-601b-48e8-b85e-efe1cbf94b0a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:07.182502 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-77ff9c99-601b-48e8-b85e-efe1cbf94b0a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:07.195707 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-77ff9c99-601b-48e8-b85e-efe1cbf94b0a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.712232 Jul 15 15:27:07.199193 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 43/88] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:06 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:27:07.274899 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-828b695f-d644-44e9-a64a-63038625eaad tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:07.289740 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-828b695f-d644-44e9-a64a-63038625eaad tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1280 microversion: 2.1 time: 0.193434 Jul 15 15:27:07.291175 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 46/89] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:07 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1280 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:07.515835 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-57262ddf-dc31-4e3a-a7c5-c00e96cbcdf4 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:07.517656 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-57262ddf-dc31-4e3a-a7c5-c00e96cbcdf4 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:07.529923 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-57262ddf-dc31-4e3a-a7c5-c00e96cbcdf4 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:07.530889 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-57262ddf-dc31-4e3a-a7c5-c00e96cbcdf4 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:07.532388 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-57262ddf-dc31-4e3a-a7c5-c00e96cbcdf4 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:07.533777 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-57262ddf-dc31-4e3a-a7c5-c00e96cbcdf4 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:07.828429 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-57262ddf-dc31-4e3a-a7c5-c00e96cbcdf4 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:07.832431 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=100 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:07.843676 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-57262ddf-dc31-4e3a-a7c5-c00e96cbcdf4 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.334870 Jul 15 15:27:07.845116 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 44/90] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:07 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:08.123346 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6095be99-f5db-4baf-8807-283511c806fd tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:08.125372 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6095be99-f5db-4baf-8807-283511c806fd tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:08.134731 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:08.138778 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6095be99-f5db-4baf-8807-283511c806fd tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:08.139748 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6095be99-f5db-4baf-8807-283511c806fd tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:08.141172 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6095be99-f5db-4baf-8807-283511c806fd tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:08.141875 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6095be99-f5db-4baf-8807-283511c806fd tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:08.226319 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3fdc9a9d-b9d3-4f9c-b3ca-89a339dee310 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:08.227908 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-3fdc9a9d-b9d3-4f9c-b3ca-89a339dee310 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:08.251241 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3fdc9a9d-b9d3-4f9c-b3ca-89a339dee310 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:08.260056 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3fdc9a9d-b9d3-4f9c-b3ca-89a339dee310 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:08.261612 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3fdc9a9d-b9d3-4f9c-b3ca-89a339dee310 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:08.268342 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3fdc9a9d-b9d3-4f9c-b3ca-89a339dee310 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:08.501325 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6095be99-f5db-4baf-8807-283511c806fd tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:08.531894 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6095be99-f5db-4baf-8807-283511c806fd tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.414817 Jul 15 15:27:08.542919 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 47/91] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:08 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:27:08.563104 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c4a6683f-a521-4f84-8ac7-906833425a87 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:08.566017 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-c4a6683f-a521-4f84-8ac7-906833425a87 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:08.584642 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c4a6683f-a521-4f84-8ac7-906833425a87 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:08.584642 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c4a6683f-a521-4f84-8ac7-906833425a87 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:08.585585 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c4a6683f-a521-4f84-8ac7-906833425a87 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:08.586639 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c4a6683f-a521-4f84-8ac7-906833425a87 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:08.618781 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=100 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:08.649597 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3fdc9a9d-b9d3-4f9c-b3ca-89a339dee310 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:08.668340 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3fdc9a9d-b9d3-4f9c-b3ca-89a339dee310 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:08.670309 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3fdc9a9d-b9d3-4f9c-b3ca-89a339dee310 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:08.671592 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-3fdc9a9d-b9d3-4f9c-b3ca-89a339dee310 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.451337 Jul 15 15:27:08.686888 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 45/92] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:08 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:27:08.855801 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c4a6683f-a521-4f84-8ac7-906833425a87 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:08.865155 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-c4a6683f-a521-4f84-8ac7-906833425a87 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 0.308561 Jul 15 15:27:08.866065 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 48/93] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:08 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:08.876467 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-65619810-3e21-4d58-9d42-a8eb769d4c93 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:08.877501 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-65619810-3e21-4d58-9d42-a8eb769d4c93 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:08.885564 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-65619810-3e21-4d58-9d42-a8eb769d4c93 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:08.886044 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-65619810-3e21-4d58-9d42-a8eb769d4c93 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:08.886988 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-65619810-3e21-4d58-9d42-a8eb769d4c93 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:08.887503 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-65619810-3e21-4d58-9d42-a8eb769d4c93 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:09.117793 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-65619810-3e21-4d58-9d42-a8eb769d4c93 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:09.132528 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-65619810-3e21-4d58-9d42-a8eb769d4c93 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.270350 Jul 15 15:27:09.134606 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 46/94] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:08 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:09.561789 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1257117f-e1d2-498c-8821-ad2a4c4c80e9 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:09.563163 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1257117f-e1d2-498c-8821-ad2a4c4c80e9 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:09.576445 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1257117f-e1d2-498c-8821-ad2a4c4c80e9 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:09.577352 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1257117f-e1d2-498c-8821-ad2a4c4c80e9 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:09.578467 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1257117f-e1d2-498c-8821-ad2a4c4c80e9 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:09.579122 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1257117f-e1d2-498c-8821-ad2a4c4c80e9 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:09.701433 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-80068123-a24e-4ecd-908b-f84c6445678c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:09.704228 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-80068123-a24e-4ecd-908b-f84c6445678c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:09.726158 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-80068123-a24e-4ecd-908b-f84c6445678c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:09.727498 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-80068123-a24e-4ecd-908b-f84c6445678c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:09.729259 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-80068123-a24e-4ecd-908b-f84c6445678c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:09.730480 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-80068123-a24e-4ecd-908b-f84c6445678c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:10.264485 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1257117f-e1d2-498c-8821-ad2a4c4c80e9 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:10.284091 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1257117f-e1d2-498c-8821-ad2a4c4c80e9 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.725762 Jul 15 15:27:10.286311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 49/95] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:09 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:10.296136 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6c34966f-aef2-4774-b1ff-ff938ceeeed8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:10.297851 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6c34966f-aef2-4774-b1ff-ff938ceeeed8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:10.312178 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6c34966f-aef2-4774-b1ff-ff938ceeeed8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:10.313384 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6c34966f-aef2-4774-b1ff-ff938ceeeed8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:10.315995 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6c34966f-aef2-4774-b1ff-ff938ceeeed8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:10.317124 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6c34966f-aef2-4774-b1ff-ff938ceeeed8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:10.393311 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-80068123-a24e-4ecd-908b-f84c6445678c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:10.413240 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-80068123-a24e-4ecd-908b-f84c6445678c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:10.414780 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-80068123-a24e-4ecd-908b-f84c6445678c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:10.419870 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-80068123-a24e-4ecd-908b-f84c6445678c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.727634 Jul 15 15:27:10.422445 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 47/96] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:09 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:27:10.430475 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-e2dfea55-f5c7-4189-8834-7b23e1e38cda tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:10.431559 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-e2dfea55-f5c7-4189-8834-7b23e1e38cda tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:10.448959 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e2dfea55-f5c7-4189-8834-7b23e1e38cda tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:10.449665 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e2dfea55-f5c7-4189-8834-7b23e1e38cda tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:10.451599 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e2dfea55-f5c7-4189-8834-7b23e1e38cda tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:10.452275 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e2dfea55-f5c7-4189-8834-7b23e1e38cda tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:10.714674 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6c34966f-aef2-4774-b1ff-ff938ceeeed8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:10.736730 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6c34966f-aef2-4774-b1ff-ff938ceeeed8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 0.448049 Jul 15 15:27:10.742698 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 50/97] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:10 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:10.813081 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e2dfea55-f5c7-4189-8834-7b23e1e38cda tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:10.836955 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-e2dfea55-f5c7-4189-8834-7b23e1e38cda tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.411951 Jul 15 15:27:10.851144 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 48/98] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:10 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:11.150239 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-8f6171e1-425a-417a-ad3a-d676f0b5b9bd req-902a11e6-c40f-4724-86b1-6c4ef7f3f136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3291b90a-688c-40b9-ba4e-ef4a6ac4beb0", "tag": "a5206037-9d2c-4d13-a70b-abb42f166a9f"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:27:11.191369 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-8f6171e1-425a-417a-ad3a-d676f0b5b9bd req-902a11e6-c40f-4724-86b1-6c4ef7f3f136 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:11.192949 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-8f6171e1-425a-417a-ad3a-d676f0b5b9bd req-902a11e6-c40f-4724-86b1-6c4ef7f3f136 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:11.227578 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-8f6171e1-425a-417a-ad3a-d676f0b5b9bd req-902a11e6-c40f-4724-86b1-6c4ef7f3f136 service nova] Creating event network-changed:a5206037-9d2c-4d13-a70b-abb42f166a9f for instance 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 on hv-cinder-85001 Jul 15 15:27:11.233316 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-8f6171e1-425a-417a-ad3a-d676f0b5b9bd req-902a11e6-c40f-4724-86b1-6c4ef7f3f136 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089889 Jul 15 15:27:11.234265 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 51/99] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:27:11.317873 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-2a904678-d782-4a19-b3e6-4e5aabc3c924 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:11.319732 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-2a904678-d782-4a19-b3e6-4e5aabc3c924 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:11.354373 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2a904678-d782-4a19-b3e6-4e5aabc3c924 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:11.354864 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2a904678-d782-4a19-b3e6-4e5aabc3c924 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:11.357662 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2a904678-d782-4a19-b3e6-4e5aabc3c924 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:11.358165 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2a904678-d782-4a19-b3e6-4e5aabc3c924 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:11.460051 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5e90da1b-65ae-4a2c-b579-3a60c5daa82b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:11.461212 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5e90da1b-65ae-4a2c-b579-3a60c5daa82b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:11.470685 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5e90da1b-65ae-4a2c-b579-3a60c5daa82b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:11.471561 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5e90da1b-65ae-4a2c-b579-3a60c5daa82b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:11.473228 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5e90da1b-65ae-4a2c-b579-3a60c5daa82b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:11.474339 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5e90da1b-65ae-4a2c-b579-3a60c5daa82b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:11.759473 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-2a904678-d782-4a19-b3e6-4e5aabc3c924 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:11.771596 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-2a904678-d782-4a19-b3e6-4e5aabc3c924 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.462611 Jul 15 15:27:11.786802 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 49/100] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:11 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:11.794432 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-252cd03b-7be9-40e5-b676-914fc64e744b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:11.795746 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-252cd03b-7be9-40e5-b676-914fc64e744b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:11.798904 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5e90da1b-65ae-4a2c-b579-3a60c5daa82b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:11.805601 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-252cd03b-7be9-40e5-b676-914fc64e744b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:11.806329 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-252cd03b-7be9-40e5-b676-914fc64e744b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:11.807747 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-252cd03b-7be9-40e5-b676-914fc64e744b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:11.808458 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-252cd03b-7be9-40e5-b676-914fc64e744b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:11.811451 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5e90da1b-65ae-4a2c-b579-3a60c5daa82b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:11.813025 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5e90da1b-65ae-4a2c-b579-3a60c5daa82b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:11.816163 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5e90da1b-65ae-4a2c-b579-3a60c5daa82b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.369078 Jul 15 15:27:11.829717 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 52/101] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:11 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:27:11.869944 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2a031e52-5416-4b80-bc7c-e20df4a6e693 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:11.870932 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-2a031e52-5416-4b80-bc7c-e20df4a6e693 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:11.881699 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2a031e52-5416-4b80-bc7c-e20df4a6e693 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:11.882225 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2a031e52-5416-4b80-bc7c-e20df4a6e693 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:11.883332 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2a031e52-5416-4b80-bc7c-e20df4a6e693 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:11.883990 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2a031e52-5416-4b80-bc7c-e20df4a6e693 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:12.133655 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-252cd03b-7be9-40e5-b676-914fc64e744b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:12.157096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-252cd03b-7be9-40e5-b676-914fc64e744b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 0.368057 Jul 15 15:27:12.159923 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 50/102] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:11 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:12.187013 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2a031e52-5416-4b80-bc7c-e20df4a6e693 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:12.203430 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-2a031e52-5416-4b80-bc7c-e20df4a6e693 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.345274 Jul 15 15:27:12.211046 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 53/103] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:11 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:27:12.807341 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-7fa31870-958f-4fe1-a7f6-5b13288c4891 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:12.808952 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-7fa31870-958f-4fe1-a7f6-5b13288c4891 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:12.819705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7fa31870-958f-4fe1-a7f6-5b13288c4891 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:12.820365 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7fa31870-958f-4fe1-a7f6-5b13288c4891 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:12.821390 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7fa31870-958f-4fe1-a7f6-5b13288c4891 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:12.822096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7fa31870-958f-4fe1-a7f6-5b13288c4891 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:12.848328 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8d90307c-4dcb-41cd-af2f-de6fe6b6d646 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:12.848938 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8d90307c-4dcb-41cd-af2f-de6fe6b6d646 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:12.863105 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8d90307c-4dcb-41cd-af2f-de6fe6b6d646 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:12.864074 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8d90307c-4dcb-41cd-af2f-de6fe6b6d646 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:12.865058 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8d90307c-4dcb-41cd-af2f-de6fe6b6d646 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:12.866620 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8d90307c-4dcb-41cd-af2f-de6fe6b6d646 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:13.169672 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-7fa31870-958f-4fe1-a7f6-5b13288c4891 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:13.189051 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8d90307c-4dcb-41cd-af2f-de6fe6b6d646 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:13.199360 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-7fa31870-958f-4fe1-a7f6-5b13288c4891 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.398154 Jul 15 15:27:13.205818 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8d90307c-4dcb-41cd-af2f-de6fe6b6d646 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:13.206954 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 51/104] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:12 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:13.216833 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8d90307c-4dcb-41cd-af2f-de6fe6b6d646 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:13.218021 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-f1bef047-af29-4e46-8d3b-967542092f16 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:13.218960 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-f1bef047-af29-4e46-8d3b-967542092f16 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:13.222326 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8d90307c-4dcb-41cd-af2f-de6fe6b6d646 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.379412 Jul 15 15:27:13.226018 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 54/105] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:12 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:27:13.236052 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f1bef047-af29-4e46-8d3b-967542092f16 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:13.237047 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f1bef047-af29-4e46-8d3b-967542092f16 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:13.238482 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f1bef047-af29-4e46-8d3b-967542092f16 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:13.244725 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0011cc1f-3230-4e75-954d-79172119b74e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:13.246015 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-0011cc1f-3230-4e75-954d-79172119b74e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:13.249226 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f1bef047-af29-4e46-8d3b-967542092f16 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:13.263924 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0011cc1f-3230-4e75-954d-79172119b74e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:13.269848 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0011cc1f-3230-4e75-954d-79172119b74e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:13.277293 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0011cc1f-3230-4e75-954d-79172119b74e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:13.278118 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0011cc1f-3230-4e75-954d-79172119b74e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:13.652938 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f1bef047-af29-4e46-8d3b-967542092f16 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:13.665062 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-f1bef047-af29-4e46-8d3b-967542092f16 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 0.456455 Jul 15 15:27:13.665918 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 52/106] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:13 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:13.698102 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0011cc1f-3230-4e75-954d-79172119b74e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:13.714348 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-0011cc1f-3230-4e75-954d-79172119b74e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.486470 Jul 15 15:27:13.719482 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 55/107] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:13 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:13.992757 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-49456000-f318-4bde-8b53-30555daa46bf req-0f6db83c-9082-4a0e-badb-e32844ee64e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5180ff6f-38fa-49c2-9663-9269dcae4849", "name": "network-vif-plugged", "status": "completed", "tag": "03d3bd84-1aa5-4842-b751-250a289b02fe"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:27:14.015409 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-49456000-f318-4bde-8b53-30555daa46bf req-0f6db83c-9082-4a0e-badb-e32844ee64e5 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:14.015943 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-49456000-f318-4bde-8b53-30555daa46bf req-0f6db83c-9082-4a0e-badb-e32844ee64e5 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:14.057872 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-49456000-f318-4bde-8b53-30555daa46bf req-0f6db83c-9082-4a0e-badb-e32844ee64e5 service nova] Creating event network-vif-plugged:03d3bd84-1aa5-4842-b751-250a289b02fe for instance 5180ff6f-38fa-49c2-9663-9269dcae4849 on hv-cinder-85001 Jul 15 15:27:14.058866 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-49456000-f318-4bde-8b53-30555daa46bf req-0f6db83c-9082-4a0e-badb-e32844ee64e5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117999) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 15 15:27:14.067205 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-86cdd6e4-a68d-431d-9858-7aca972f9397 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:14.067205 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-86cdd6e4-a68d-431d-9858-7aca972f9397 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:14.067205 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-86cdd6e4-a68d-431d-9858-7aca972f9397 None None] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:14.067205 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-86cdd6e4-a68d-431d-9858-7aca972f9397 None None] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:14.086613 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.compute.rpcapi [None req-86cdd6e4-a68d-431d-9858-7aca972f9397 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 15 15:27:14.089068 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-86cdd6e4-a68d-431d-9858-7aca972f9397 None None] Releasing lock "compute-rpcapi-router" {{(pid=117999) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 15 15:27:14.112482 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-86cdd6e4-a68d-431d-9858-7aca972f9397 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.258351 Jul 15 15:27:14.113944 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 53/108] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:27:14.224331 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-578ddd3f-b221-43ab-9c6c-796da4934285 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:14.225176 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-578ddd3f-b221-43ab-9c6c-796da4934285 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:14.248825 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-578ddd3f-b221-43ab-9c6c-796da4934285 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:14.249343 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-578ddd3f-b221-43ab-9c6c-796da4934285 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:14.250979 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-578ddd3f-b221-43ab-9c6c-796da4934285 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:14.251496 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-578ddd3f-b221-43ab-9c6c-796da4934285 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:14.254745 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-766350d7-6ccf-4cf9-8eb1-77435912de4d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:14.257848 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-766350d7-6ccf-4cf9-8eb1-77435912de4d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:14.285277 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-766350d7-6ccf-4cf9-8eb1-77435912de4d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:14.285903 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-766350d7-6ccf-4cf9-8eb1-77435912de4d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:14.292531 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-766350d7-6ccf-4cf9-8eb1-77435912de4d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:14.293426 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-766350d7-6ccf-4cf9-8eb1-77435912de4d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:14.657239 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-766350d7-6ccf-4cf9-8eb1-77435912de4d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:14.672721 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-578ddd3f-b221-43ab-9c6c-796da4934285 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:14.675612 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-766350d7-6ccf-4cf9-8eb1-77435912de4d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:14.678543 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-766350d7-6ccf-4cf9-8eb1-77435912de4d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:14.680897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-766350d7-6ccf-4cf9-8eb1-77435912de4d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.432907 Jul 15 15:27:14.682165 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 54/109] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:14 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:27:14.683089 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-578ddd3f-b221-43ab-9c6c-796da4934285 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.466798 Jul 15 15:27:14.684356 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 56/110] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:14 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:14.690560 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-b2cb32f8-de6c-49c9-84ba-469424d56215 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:14.691915 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-b2cb32f8-de6c-49c9-84ba-469424d56215 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:14.702511 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b2cb32f8-de6c-49c9-84ba-469424d56215 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:14.703612 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b2cb32f8-de6c-49c9-84ba-469424d56215 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:14.705466 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b2cb32f8-de6c-49c9-84ba-469424d56215 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:14.706284 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b2cb32f8-de6c-49c9-84ba-469424d56215 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:14.745024 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6c05df2a-00ae-41f4-a3d2-5d296540f973 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:14.745569 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6c05df2a-00ae-41f4-a3d2-5d296540f973 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:14.756794 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6c05df2a-00ae-41f4-a3d2-5d296540f973 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:14.757520 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6c05df2a-00ae-41f4-a3d2-5d296540f973 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:14.758797 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6c05df2a-00ae-41f4-a3d2-5d296540f973 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:14.760188 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6c05df2a-00ae-41f4-a3d2-5d296540f973 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:14.980353 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6c05df2a-00ae-41f4-a3d2-5d296540f973 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:14.994947 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6c05df2a-00ae-41f4-a3d2-5d296540f973 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.256939 Jul 15 15:27:14.995979 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 57/111] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:14 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:27:15.030761 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b2cb32f8-de6c-49c9-84ba-469424d56215 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:15.047841 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-b2cb32f8-de6c-49c9-84ba-469424d56215 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 0.362776 Jul 15 15:27:15.049476 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 55/112] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:14 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:15.714035 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-702f98c1-579e-47d6-a9f8-7350254cec20 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:15.714895 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-702f98c1-579e-47d6-a9f8-7350254cec20 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:15.722482 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-702f98c1-579e-47d6-a9f8-7350254cec20 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:15.722960 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-702f98c1-579e-47d6-a9f8-7350254cec20 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:15.723744 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-702f98c1-579e-47d6-a9f8-7350254cec20 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:15.724168 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-702f98c1-579e-47d6-a9f8-7350254cec20 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:15.724975 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-94ec9642-b309-44b9-bd55-eb1b938093c2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:15.725728 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-94ec9642-b309-44b9-bd55-eb1b938093c2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:15.742079 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-94ec9642-b309-44b9-bd55-eb1b938093c2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:15.742719 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-94ec9642-b309-44b9-bd55-eb1b938093c2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:15.743933 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-94ec9642-b309-44b9-bd55-eb1b938093c2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:15.744748 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-94ec9642-b309-44b9-bd55-eb1b938093c2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:15.975708 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-702f98c1-579e-47d6-a9f8-7350254cec20 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:15.987963 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-702f98c1-579e-47d6-a9f8-7350254cec20 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.279633 Jul 15 15:27:15.988178 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-94ec9642-b309-44b9-bd55-eb1b938093c2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:15.988837 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 58/113] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:15 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:16.006500 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-94ec9642-b309-44b9-bd55-eb1b938093c2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:16.008829 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-94ec9642-b309-44b9-bd55-eb1b938093c2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:16.010008 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-94ec9642-b309-44b9-bd55-eb1b938093c2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.301600 Jul 15 15:27:16.010602 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 56/114] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:15 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:27:16.016079 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f2f20a4c-2bee-459e-a7c3-f0cff790ff17 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:16.016716 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f2f20a4c-2bee-459e-a7c3-f0cff790ff17 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:16.023580 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f2f20a4c-2bee-459e-a7c3-f0cff790ff17 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:16.024022 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f2f20a4c-2bee-459e-a7c3-f0cff790ff17 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:16.024796 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f2f20a4c-2bee-459e-a7c3-f0cff790ff17 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:16.025223 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f2f20a4c-2bee-459e-a7c3-f0cff790ff17 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:16.079128 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-d2a06227-8819-4f62-a97e-9ec913a09d92 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:16.080392 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-d2a06227-8819-4f62-a97e-9ec913a09d92 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:16.090913 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d2a06227-8819-4f62-a97e-9ec913a09d92 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:16.091471 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d2a06227-8819-4f62-a97e-9ec913a09d92 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:16.092328 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d2a06227-8819-4f62-a97e-9ec913a09d92 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:16.092841 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d2a06227-8819-4f62-a97e-9ec913a09d92 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:16.318635 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f2f20a4c-2bee-459e-a7c3-f0cff790ff17 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:16.333417 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f2f20a4c-2bee-459e-a7c3-f0cff790ff17 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.321175 Jul 15 15:27:16.347040 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 59/115] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:16 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:27:16.367016 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-d2a06227-8819-4f62-a97e-9ec913a09d92 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:16.376914 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-d2a06227-8819-4f62-a97e-9ec913a09d92 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 0.303762 Jul 15 15:27:16.377713 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 57/116] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:16 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:27:17.007775 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b544fe81-7b0d-4b8f-b605-4fd246cf9e6b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:17.009421 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b544fe81-7b0d-4b8f-b605-4fd246cf9e6b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:17.018156 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b544fe81-7b0d-4b8f-b605-4fd246cf9e6b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:17.018639 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b544fe81-7b0d-4b8f-b605-4fd246cf9e6b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:17.019793 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b544fe81-7b0d-4b8f-b605-4fd246cf9e6b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:17.020235 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b544fe81-7b0d-4b8f-b605-4fd246cf9e6b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:17.047146 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-668c3cb9-43a2-4524-b2a4-2bb486d8f122 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:17.048261 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-668c3cb9-43a2-4524-b2a4-2bb486d8f122 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:17.058030 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-668c3cb9-43a2-4524-b2a4-2bb486d8f122 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:17.058940 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-668c3cb9-43a2-4524-b2a4-2bb486d8f122 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:17.060293 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-668c3cb9-43a2-4524-b2a4-2bb486d8f122 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:17.060977 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-668c3cb9-43a2-4524-b2a4-2bb486d8f122 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:17.278655 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b544fe81-7b0d-4b8f-b605-4fd246cf9e6b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:17.291052 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-668c3cb9-43a2-4524-b2a4-2bb486d8f122 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:17.293694 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b544fe81-7b0d-4b8f-b605-4fd246cf9e6b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.289285 Jul 15 15:27:17.294301 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 60/117] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:17 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:17.306066 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-668c3cb9-43a2-4524-b2a4-2bb486d8f122 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:17.309549 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-668c3cb9-43a2-4524-b2a4-2bb486d8f122 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:17.312301 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-668c3cb9-43a2-4524-b2a4-2bb486d8f122 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.271454 Jul 15 15:27:17.323917 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 58/118] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:17 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:27:17.370921 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-29b2eb28-ae75-4bf0-bf95-bbf0712deec9 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:17.370921 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-29b2eb28-ae75-4bf0-bf95-bbf0712deec9 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:17.380620 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-29b2eb28-ae75-4bf0-bf95-bbf0712deec9 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:17.381316 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-29b2eb28-ae75-4bf0-bf95-bbf0712deec9 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:17.382163 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-29b2eb28-ae75-4bf0-bf95-bbf0712deec9 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:17.382792 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-29b2eb28-ae75-4bf0-bf95-bbf0712deec9 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:17.410295 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3a72e305-e335-4db6-a384-6a9b2ba7eaff tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:17.411079 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-3a72e305-e335-4db6-a384-6a9b2ba7eaff tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:17.418017 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3a72e305-e335-4db6-a384-6a9b2ba7eaff tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:17.418763 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3a72e305-e335-4db6-a384-6a9b2ba7eaff tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:17.420165 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3a72e305-e335-4db6-a384-6a9b2ba7eaff tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:17.421039 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3a72e305-e335-4db6-a384-6a9b2ba7eaff tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:17.635047 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-29b2eb28-ae75-4bf0-bf95-bbf0712deec9 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:17.646803 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-29b2eb28-ae75-4bf0-bf95-bbf0712deec9 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.281771 Jul 15 15:27:17.647974 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 61/119] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:17 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:17.684110 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3a72e305-e335-4db6-a384-6a9b2ba7eaff tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:17.701304 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-3a72e305-e335-4db6-a384-6a9b2ba7eaff tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 0.299074 Jul 15 15:27:17.702126 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 59/120] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:17 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:27:18.326571 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-07b34ce5-a466-4798-94ab-d221a779088a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:18.327427 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-07b34ce5-a466-4798-94ab-d221a779088a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:18.332578 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-59b9c1de-f10b-4c88-ba06-7063bc5bfd8a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:18.333340 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-59b9c1de-f10b-4c88-ba06-7063bc5bfd8a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:18.334463 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-07b34ce5-a466-4798-94ab-d221a779088a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:18.334900 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-07b34ce5-a466-4798-94ab-d221a779088a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:18.338134 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-07b34ce5-a466-4798-94ab-d221a779088a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:18.338134 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-07b34ce5-a466-4798-94ab-d221a779088a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:18.343107 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-59b9c1de-f10b-4c88-ba06-7063bc5bfd8a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:18.343859 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-59b9c1de-f10b-4c88-ba06-7063bc5bfd8a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:18.345205 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-59b9c1de-f10b-4c88-ba06-7063bc5bfd8a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:18.345956 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-59b9c1de-f10b-4c88-ba06-7063bc5bfd8a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:18.613916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-59b9c1de-f10b-4c88-ba06-7063bc5bfd8a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:18.624497 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-07b34ce5-a466-4798-94ab-d221a779088a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:18.631414 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-59b9c1de-f10b-4c88-ba06-7063bc5bfd8a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:18.635428 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-59b9c1de-f10b-4c88-ba06-7063bc5bfd8a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:18.638051 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-59b9c1de-f10b-4c88-ba06-7063bc5bfd8a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.309673 Jul 15 15:27:18.640045 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 60/121] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:18 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:27:18.655438 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-07b34ce5-a466-4798-94ab-d221a779088a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.336119 Jul 15 15:27:18.656078 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 62/122] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:18 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:18.676902 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-1591a339-a031-400f-87f1-94e21ab64343 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:18.677545 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-1591a339-a031-400f-87f1-94e21ab64343 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:18.683971 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1591a339-a031-400f-87f1-94e21ab64343 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:18.684413 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1591a339-a031-400f-87f1-94e21ab64343 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:18.685179 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1591a339-a031-400f-87f1-94e21ab64343 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:18.685618 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1591a339-a031-400f-87f1-94e21ab64343 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:18.724975 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f2031e42-4047-43fb-8749-5f4368c18277 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:18.725577 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f2031e42-4047-43fb-8749-5f4368c18277 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:18.734912 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f2031e42-4047-43fb-8749-5f4368c18277 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:18.735766 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f2031e42-4047-43fb-8749-5f4368c18277 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:18.736865 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f2031e42-4047-43fb-8749-5f4368c18277 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:18.737756 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f2031e42-4047-43fb-8749-5f4368c18277 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:18.960936 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1591a339-a031-400f-87f1-94e21ab64343 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:18.965372 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=100 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:18.965877 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f2031e42-4047-43fb-8749-5f4368c18277 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:18.972422 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-1591a339-a031-400f-87f1-94e21ab64343 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.300005 Jul 15 15:27:18.973010 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 61/123] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:18 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:18.977267 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f2031e42-4047-43fb-8749-5f4368c18277 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 0.256457 Jul 15 15:27:18.978112 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 63/124] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:18 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:27:19.660618 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-f44e9cee-bc30-4e43-8bc4-98bc45585cdd tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:19.661229 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-f44e9cee-bc30-4e43-8bc4-98bc45585cdd tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:19.682809 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1f728cf1-6856-465f-861d-3d79a6f07b7a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:19.683776 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1f728cf1-6856-465f-861d-3d79a6f07b7a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:19.684621 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f44e9cee-bc30-4e43-8bc4-98bc45585cdd tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:19.685410 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f44e9cee-bc30-4e43-8bc4-98bc45585cdd tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:19.686778 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f44e9cee-bc30-4e43-8bc4-98bc45585cdd tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:19.687550 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f44e9cee-bc30-4e43-8bc4-98bc45585cdd tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:19.692388 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1f728cf1-6856-465f-861d-3d79a6f07b7a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:19.692865 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1f728cf1-6856-465f-861d-3d79a6f07b7a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:19.693717 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1f728cf1-6856-465f-861d-3d79a6f07b7a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:19.694309 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1f728cf1-6856-465f-861d-3d79a6f07b7a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:19.964269 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f44e9cee-bc30-4e43-8bc4-98bc45585cdd tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:19.967785 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1f728cf1-6856-465f-861d-3d79a6f07b7a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:19.978619 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1f728cf1-6856-465f-861d-3d79a6f07b7a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.308620 Jul 15 15:27:19.979519 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 64/125] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:19 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:19.980128 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f44e9cee-bc30-4e43-8bc4-98bc45585cdd tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:19.982586 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f44e9cee-bc30-4e43-8bc4-98bc45585cdd tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:19.984484 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-f44e9cee-bc30-4e43-8bc4-98bc45585cdd tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.328367 Jul 15 15:27:19.987046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 62/126] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:19 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:27:19.993033 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5695f08a-5244-4d43-b866-f498dcc6c23c tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:19.993857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5695f08a-5244-4d43-b866-f498dcc6c23c tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:20.002401 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5695f08a-5244-4d43-b866-f498dcc6c23c tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:20.002986 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5695f08a-5244-4d43-b866-f498dcc6c23c tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:20.004340 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5695f08a-5244-4d43-b866-f498dcc6c23c tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:20.004676 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-50447546-d240-4485-8eab-12c2664031f3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:20.004923 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5695f08a-5244-4d43-b866-f498dcc6c23c tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:20.005435 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-50447546-d240-4485-8eab-12c2664031f3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:20.012233 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-50447546-d240-4485-8eab-12c2664031f3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:20.012672 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-50447546-d240-4485-8eab-12c2664031f3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:20.013446 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-50447546-d240-4485-8eab-12c2664031f3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:20.013871 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-50447546-d240-4485-8eab-12c2664031f3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:20.270331 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5695f08a-5244-4d43-b866-f498dcc6c23c tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:20.275988 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=100 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:20.287178 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5695f08a-5244-4d43-b866-f498dcc6c23c tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.298378 Jul 15 15:27:20.288748 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 65/127] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:19 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:27:20.322601 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-50447546-d240-4485-8eab-12c2664031f3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:20.338507 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-50447546-d240-4485-8eab-12c2664031f3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 0.340459 Jul 15 15:27:20.340677 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 63/128] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:19 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:21.006244 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2a7e92f2-0a14-4075-a1dd-ac14ecc8c223 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:21.007374 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-2a7e92f2-0a14-4075-a1dd-ac14ecc8c223 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:21.014311 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-6c4a9faf-e0d3-4118-aaa5-d98250f4ebe6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:21.015193 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-6c4a9faf-e0d3-4118-aaa5-d98250f4ebe6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:21.023391 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2a7e92f2-0a14-4075-a1dd-ac14ecc8c223 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:21.024232 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2a7e92f2-0a14-4075-a1dd-ac14ecc8c223 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:21.025785 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2a7e92f2-0a14-4075-a1dd-ac14ecc8c223 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:21.026131 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6c4a9faf-e0d3-4118-aaa5-d98250f4ebe6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:21.026556 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2a7e92f2-0a14-4075-a1dd-ac14ecc8c223 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:21.026844 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6c4a9faf-e0d3-4118-aaa5-d98250f4ebe6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:21.028110 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6c4a9faf-e0d3-4118-aaa5-d98250f4ebe6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:21.028771 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6c4a9faf-e0d3-4118-aaa5-d98250f4ebe6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:21.285237 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2a7e92f2-0a14-4075-a1dd-ac14ecc8c223 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:21.289126 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6c4a9faf-e0d3-4118-aaa5-d98250f4ebe6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:21.294731 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-2a7e92f2-0a14-4075-a1dd-ac14ecc8c223 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.297345 Jul 15 15:27:21.296546 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 66/129] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:20 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:21.298228 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6c4a9faf-e0d3-4118-aaa5-d98250f4ebe6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:21.299840 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6c4a9faf-e0d3-4118-aaa5-d98250f4ebe6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:21.301024 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-6c4a9faf-e0d3-4118-aaa5-d98250f4ebe6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.293608 Jul 15 15:27:21.301597 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 64/130] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:21 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:27:21.315579 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f57727a4-176f-47f8-ad19-0c1ceacb0d9f tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:21.316327 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f57727a4-176f-47f8-ad19-0c1ceacb0d9f tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:21.323760 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f57727a4-176f-47f8-ad19-0c1ceacb0d9f tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:21.324238 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f57727a4-176f-47f8-ad19-0c1ceacb0d9f tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:21.325028 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f57727a4-176f-47f8-ad19-0c1ceacb0d9f tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:21.325505 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f57727a4-176f-47f8-ad19-0c1ceacb0d9f tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:21.362141 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-f54030d2-608a-4f07-9fa1-a7427392dbe9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:21.363208 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-f54030d2-608a-4f07-9fa1-a7427392dbe9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:21.372168 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f54030d2-608a-4f07-9fa1-a7427392dbe9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:21.372937 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f54030d2-608a-4f07-9fa1-a7427392dbe9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:21.374590 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f54030d2-608a-4f07-9fa1-a7427392dbe9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:21.375614 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f54030d2-608a-4f07-9fa1-a7427392dbe9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:21.651127 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f57727a4-176f-47f8-ad19-0c1ceacb0d9f tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:21.663798 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f57727a4-176f-47f8-ad19-0c1ceacb0d9f tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.352545 Jul 15 15:27:21.665082 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 67/131] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:21 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:21.671581 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f54030d2-608a-4f07-9fa1-a7427392dbe9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:21.689873 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-f54030d2-608a-4f07-9fa1-a7427392dbe9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 0.333708 Jul 15 15:27:21.690749 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 65/132] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:21 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:27:22.057195 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-118922aa-e990-45d0-989f-5e098e7bbe52 req-3fc5c107-6fc5-42aa-af70-509e175e8ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59fc0e3c-5238-40d8-a589-60ceb542cf30", "name": "network-vif-plugged", "status": "completed", "tag": "41019c37-3597-4667-9423-efc3b2c8ab76"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:27:22.091351 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-118922aa-e990-45d0-989f-5e098e7bbe52 req-3fc5c107-6fc5-42aa-af70-509e175e8ad0 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:22.092593 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-118922aa-e990-45d0-989f-5e098e7bbe52 req-3fc5c107-6fc5-42aa-af70-509e175e8ad0 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:22.123039 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-118922aa-e990-45d0-989f-5e098e7bbe52 req-3fc5c107-6fc5-42aa-af70-509e175e8ad0 service nova] Creating event network-vif-plugged:41019c37-3597-4667-9423-efc3b2c8ab76 for instance 59fc0e3c-5238-40d8-a589-60ceb542cf30 on hv-cinder-85001 Jul 15 15:27:22.143717 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-118922aa-e990-45d0-989f-5e098e7bbe52 req-3fc5c107-6fc5-42aa-af70-509e175e8ad0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086600 Jul 15 15:27:22.144540 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 68/133] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:27:22.323342 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-fcec9b66-18fb-4cdb-9cfb-7a21c760abc6 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:22.325258 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-fcec9b66-18fb-4cdb-9cfb-7a21c760abc6 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:22.328241 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4c7af790-ff58-4078-92ff-148a568b239b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:22.330618 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-4c7af790-ff58-4078-92ff-148a568b239b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:22.339837 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:22.348621 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4c7af790-ff58-4078-92ff-148a568b239b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:22.350715 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4c7af790-ff58-4078-92ff-148a568b239b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:22.353054 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4c7af790-ff58-4078-92ff-148a568b239b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:22.354188 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4c7af790-ff58-4078-92ff-148a568b239b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:22.354363 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fcec9b66-18fb-4cdb-9cfb-7a21c760abc6 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:22.355004 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fcec9b66-18fb-4cdb-9cfb-7a21c760abc6 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:22.356524 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fcec9b66-18fb-4cdb-9cfb-7a21c760abc6 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:22.360897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fcec9b66-18fb-4cdb-9cfb-7a21c760abc6 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:22.737651 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-fcec9b66-18fb-4cdb-9cfb-7a21c760abc6 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:22.744316 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-4c7af790-ff58-4078-92ff-148a568b239b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:22.753313 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-fcec9b66-18fb-4cdb-9cfb-7a21c760abc6 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.436152 Jul 15 15:27:22.755053 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 66/134] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:22 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:22.765034 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-482e22ce-2ca3-48e0-8dbd-89bd009712d0 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:22.767580 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-482e22ce-2ca3-48e0-8dbd-89bd009712d0 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:22.773039 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-4c7af790-ff58-4078-92ff-148a568b239b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:22.774649 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-4c7af790-ff58-4078-92ff-148a568b239b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:22.776162 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4c7af790-ff58-4078-92ff-148a568b239b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.458955 Jul 15 15:27:22.776898 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-482e22ce-2ca3-48e0-8dbd-89bd009712d0 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:22.777093 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 69/135] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:22 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:27:22.778133 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-482e22ce-2ca3-48e0-8dbd-89bd009712d0 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:22.779524 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-482e22ce-2ca3-48e0-8dbd-89bd009712d0 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:22.780302 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-482e22ce-2ca3-48e0-8dbd-89bd009712d0 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:22.786362 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-785b7da9-b9e7-4547-a75f-4a1ccb46516b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:22.787739 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-785b7da9-b9e7-4547-a75f-4a1ccb46516b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:22.791477 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=84 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:22.806450 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-785b7da9-b9e7-4547-a75f-4a1ccb46516b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:22.807264 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-785b7da9-b9e7-4547-a75f-4a1ccb46516b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:22.808341 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-785b7da9-b9e7-4547-a75f-4a1ccb46516b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:22.809104 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-785b7da9-b9e7-4547-a75f-4a1ccb46516b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:23.118957 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-482e22ce-2ca3-48e0-8dbd-89bd009712d0 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:23.125984 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-785b7da9-b9e7-4547-a75f-4a1ccb46516b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:23.132126 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-482e22ce-2ca3-48e0-8dbd-89bd009712d0 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.374061 Jul 15 15:27:23.133585 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 67/136] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:22 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:23.148427 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-785b7da9-b9e7-4547-a75f-4a1ccb46516b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 0.369629 Jul 15 15:27:23.149537 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 70/137] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:22 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:23.777290 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-6fa61b0a-b7c0-4a07-8273-8cff91ff6a66 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:23.778313 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-6fa61b0a-b7c0-4a07-8273-8cff91ff6a66 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:23.786806 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6fa61b0a-b7c0-4a07-8273-8cff91ff6a66 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:23.787343 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6fa61b0a-b7c0-4a07-8273-8cff91ff6a66 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:23.788493 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6fa61b0a-b7c0-4a07-8273-8cff91ff6a66 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:23.788961 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6fa61b0a-b7c0-4a07-8273-8cff91ff6a66 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:23.801297 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-089c0ac9-64b7-4840-b1b6-b657cb58debb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:23.801966 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-089c0ac9-64b7-4840-b1b6-b657cb58debb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:23.814256 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-089c0ac9-64b7-4840-b1b6-b657cb58debb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:23.815063 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-089c0ac9-64b7-4840-b1b6-b657cb58debb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:23.816357 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-089c0ac9-64b7-4840-b1b6-b657cb58debb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:23.816851 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-089c0ac9-64b7-4840-b1b6-b657cb58debb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:24.083382 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=2 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:24.099119 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6fa61b0a-b7c0-4a07-8273-8cff91ff6a66 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:24.113256 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-6fa61b0a-b7c0-4a07-8273-8cff91ff6a66 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.341122 Jul 15 15:27:24.114813 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 68/138] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:23 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:24.152972 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-089c0ac9-64b7-4840-b1b6-b657cb58debb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:24.162988 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-5107d9df-f092-4261-9473-c202b09bda24 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:24.165133 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-5107d9df-f092-4261-9473-c202b09bda24 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:24.170147 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-089c0ac9-64b7-4840-b1b6-b657cb58debb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:24.173010 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-089c0ac9-64b7-4840-b1b6-b657cb58debb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:24.175540 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-089c0ac9-64b7-4840-b1b6-b657cb58debb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.381952 Jul 15 15:27:24.177122 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 71/139] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:23 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:27:24.190363 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5107d9df-f092-4261-9473-c202b09bda24 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:24.191122 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5107d9df-f092-4261-9473-c202b09bda24 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:24.191663 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5107d9df-f092-4261-9473-c202b09bda24 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:24.192401 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5107d9df-f092-4261-9473-c202b09bda24 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:24.214561 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9925df05-1256-442a-9434-5a8f34592179 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:24.223177 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9925df05-1256-442a-9434-5a8f34592179 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:24.254387 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9925df05-1256-442a-9434-5a8f34592179 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:24.256306 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9925df05-1256-442a-9434-5a8f34592179 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:24.260240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9925df05-1256-442a-9434-5a8f34592179 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:24.261180 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9925df05-1256-442a-9434-5a8f34592179 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:24.560963 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9925df05-1256-442a-9434-5a8f34592179 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:24.565336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-5107d9df-f092-4261-9473-c202b09bda24 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:24.574657 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9925df05-1256-442a-9434-5a8f34592179 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 0.395673 Jul 15 15:27:24.575966 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 72/140] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:24 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:24.592468 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-5107d9df-f092-4261-9473-c202b09bda24 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.433308 Jul 15 15:27:24.599490 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 69/141] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:24 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:25.145658 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-fc8c8481-3bfa-425d-a127-5137dfaab6bd tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:25.146426 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-fc8c8481-3bfa-425d-a127-5137dfaab6bd tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:25.155132 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fc8c8481-3bfa-425d-a127-5137dfaab6bd tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:25.156006 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fc8c8481-3bfa-425d-a127-5137dfaab6bd tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:25.156603 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fc8c8481-3bfa-425d-a127-5137dfaab6bd tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:25.157956 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fc8c8481-3bfa-425d-a127-5137dfaab6bd tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:25.198279 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-aa033bb9-23e4-446f-8446-1327a61f219f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:25.199867 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-aa033bb9-23e4-446f-8446-1327a61f219f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:25.209025 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-aa033bb9-23e4-446f-8446-1327a61f219f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:25.209922 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-aa033bb9-23e4-446f-8446-1327a61f219f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:25.211373 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-aa033bb9-23e4-446f-8446-1327a61f219f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:25.211977 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-aa033bb9-23e4-446f-8446-1327a61f219f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:25.547322 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-fc8c8481-3bfa-425d-a127-5137dfaab6bd tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:25.556035 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-fc8c8481-3bfa-425d-a127-5137dfaab6bd tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.416897 Jul 15 15:27:25.557034 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 73/142] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:25 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:25.601774 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-643ba3bd-d919-4241-b340-0a320f2e6054 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:25.604890 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-643ba3bd-d919-4241-b340-0a320f2e6054 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:25.610768 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-aa033bb9-23e4-446f-8446-1327a61f219f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:25.613459 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-643ba3bd-d919-4241-b340-0a320f2e6054 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:25.614027 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-643ba3bd-d919-4241-b340-0a320f2e6054 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:25.614929 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-643ba3bd-d919-4241-b340-0a320f2e6054 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:25.615170 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-643ba3bd-d919-4241-b340-0a320f2e6054 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:25.623679 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-aa033bb9-23e4-446f-8446-1327a61f219f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:25.625493 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-aa033bb9-23e4-446f-8446-1327a61f219f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:25.627251 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-aa033bb9-23e4-446f-8446-1327a61f219f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.434633 Jul 15 15:27:25.627828 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 70/143] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:25 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:27:25.633704 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-91fdb8f3-bc95-4868-9b3f-06ea861eb8aa tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:25.635075 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-91fdb8f3-bc95-4868-9b3f-06ea861eb8aa tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:25.646558 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-91fdb8f3-bc95-4868-9b3f-06ea861eb8aa tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:25.648341 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-91fdb8f3-bc95-4868-9b3f-06ea861eb8aa tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:25.650018 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-91fdb8f3-bc95-4868-9b3f-06ea861eb8aa tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:25.650966 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-91fdb8f3-bc95-4868-9b3f-06ea861eb8aa tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:26.152897 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-643ba3bd-d919-4241-b340-0a320f2e6054 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:26.165883 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-643ba3bd-d919-4241-b340-0a320f2e6054 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 0.568078 Jul 15 15:27:26.171869 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 74/144] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:25 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:27:26.177796 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-91fdb8f3-bc95-4868-9b3f-06ea861eb8aa tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:26.188186 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-91fdb8f3-bc95-4868-9b3f-06ea861eb8aa tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.558900 Jul 15 15:27:26.195879 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 71/145] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:25 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:26.605377 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d52f937a-d602-45ce-990c-6faef81c0328 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:26.608165 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d52f937a-d602-45ce-990c-6faef81c0328 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:26.623272 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d52f937a-d602-45ce-990c-6faef81c0328 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:26.624166 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d52f937a-d602-45ce-990c-6faef81c0328 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:26.625869 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d52f937a-d602-45ce-990c-6faef81c0328 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:26.626807 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d52f937a-d602-45ce-990c-6faef81c0328 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:26.658663 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-f84ce271-ede3-48a2-ab84-64574a423d8d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:26.660651 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-f84ce271-ede3-48a2-ab84-64574a423d8d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:26.673739 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f84ce271-ede3-48a2-ab84-64574a423d8d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:26.674611 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f84ce271-ede3-48a2-ab84-64574a423d8d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:26.676556 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f84ce271-ede3-48a2-ab84-64574a423d8d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:26.677255 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f84ce271-ede3-48a2-ab84-64574a423d8d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:27.214759 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d52f937a-d602-45ce-990c-6faef81c0328 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:27.234171 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d52f937a-d602-45ce-990c-6faef81c0328 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.651729 Jul 15 15:27:27.236386 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 75/146] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:26 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:27.261071 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1d2154ad-456f-450e-bb8d-a5e122d8badf tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:27.263630 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1d2154ad-456f-450e-bb8d-a5e122d8badf tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:27.283237 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1d2154ad-456f-450e-bb8d-a5e122d8badf tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:27.284802 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1d2154ad-456f-450e-bb8d-a5e122d8badf tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:27.286884 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1d2154ad-456f-450e-bb8d-a5e122d8badf tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:27.288024 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1d2154ad-456f-450e-bb8d-a5e122d8badf tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:27.366135 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f84ce271-ede3-48a2-ab84-64574a423d8d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:27.386611 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f84ce271-ede3-48a2-ab84-64574a423d8d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:27.391493 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f84ce271-ede3-48a2-ab84-64574a423d8d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:27.395151 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-f84ce271-ede3-48a2-ab84-64574a423d8d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.746005 Jul 15 15:27:27.399570 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 72/147] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:26 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:27:27.426829 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-d51988bb-0cc3-4ca2-9798-94db7d606f8e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:27.426829 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-d51988bb-0cc3-4ca2-9798-94db7d606f8e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:27.450901 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d51988bb-0cc3-4ca2-9798-94db7d606f8e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:27.451399 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d51988bb-0cc3-4ca2-9798-94db7d606f8e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:27.453206 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d51988bb-0cc3-4ca2-9798-94db7d606f8e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:27.453206 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d51988bb-0cc3-4ca2-9798-94db7d606f8e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:28.265147 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1d2154ad-456f-450e-bb8d-a5e122d8badf tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:28.276000 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1d2154ad-456f-450e-bb8d-a5e122d8badf tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 1.037711 Jul 15 15:27:28.276633 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 76/148] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:27 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:28.279693 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-d51988bb-0cc3-4ca2-9798-94db7d606f8e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:28.290313 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-d51988bb-0cc3-4ca2-9798-94db7d606f8e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.888088 Jul 15 15:27:28.291362 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 73/149] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:27 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:28.296530 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1d813814-7f61-44f0-96b3-a09869b4a549 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:28.297581 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1d813814-7f61-44f0-96b3-a09869b4a549 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:28.305894 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1d813814-7f61-44f0-96b3-a09869b4a549 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:28.306353 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1d813814-7f61-44f0-96b3-a09869b4a549 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:28.307312 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1d813814-7f61-44f0-96b3-a09869b4a549 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:28.307738 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1d813814-7f61-44f0-96b3-a09869b4a549 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:28.432747 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-bdc3f31d-d479-4c91-9d5b-cb3ca1b36790 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:28.434560 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-bdc3f31d-d479-4c91-9d5b-cb3ca1b36790 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:28.446625 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bdc3f31d-d479-4c91-9d5b-cb3ca1b36790 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:28.447836 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bdc3f31d-d479-4c91-9d5b-cb3ca1b36790 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:28.449475 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bdc3f31d-d479-4c91-9d5b-cb3ca1b36790 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:28.450318 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bdc3f31d-d479-4c91-9d5b-cb3ca1b36790 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:29.159492 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-bdc3f31d-d479-4c91-9d5b-cb3ca1b36790 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:29.178282 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-bdc3f31d-d479-4c91-9d5b-cb3ca1b36790 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:29.180914 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-bdc3f31d-d479-4c91-9d5b-cb3ca1b36790 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:29.192413 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-bdc3f31d-d479-4c91-9d5b-cb3ca1b36790 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.767331 Jul 15 15:27:29.194200 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 74/150] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:28 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:27:29.297677 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-53158eab-7d60-43ed-a489-f2d508cb6783 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:29.298825 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-53158eab-7d60-43ed-a489-f2d508cb6783 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:29.325877 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-53158eab-7d60-43ed-a489-f2d508cb6783 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:29.326577 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-53158eab-7d60-43ed-a489-f2d508cb6783 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:29.327945 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-53158eab-7d60-43ed-a489-f2d508cb6783 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:29.328776 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-53158eab-7d60-43ed-a489-f2d508cb6783 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:29.730952 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1d813814-7f61-44f0-96b3-a09869b4a549 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:29.755696 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1d813814-7f61-44f0-96b3-a09869b4a549 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 1.462435 Jul 15 15:27:29.757069 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 77/151] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:28 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:29.772340 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ad2fb8c3-ffc5-4f0c-bbdc-2e6f6ad12d59 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:29.774173 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ad2fb8c3-ffc5-4f0c-bbdc-2e6f6ad12d59 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:29.787756 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ad2fb8c3-ffc5-4f0c-bbdc-2e6f6ad12d59 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:29.788977 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ad2fb8c3-ffc5-4f0c-bbdc-2e6f6ad12d59 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:29.791520 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ad2fb8c3-ffc5-4f0c-bbdc-2e6f6ad12d59 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:29.793799 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ad2fb8c3-ffc5-4f0c-bbdc-2e6f6ad12d59 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:30.165141 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-53158eab-7d60-43ed-a489-f2d508cb6783 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:30.199358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-53158eab-7d60-43ed-a489-f2d508cb6783 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 0.908576 Jul 15 15:27:30.201216 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 75/152] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:29 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:27:30.207328 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-046c7bac-73b1-445f-8185-bca1451741ec req-c8826552-ccd5-4768-b783-e0a3b7fbb442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d95c0294-3423-429b-8bcf-43e2089fca23", "name": "network-vif-plugged", "status": "completed", "tag": "342c12f2-654f-4608-be83-59dbef84ae43"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:27:30.228144 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-046c7bac-73b1-445f-8185-bca1451741ec req-c8826552-ccd5-4768-b783-e0a3b7fbb442 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:30.228718 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-046c7bac-73b1-445f-8185-bca1451741ec req-c8826552-ccd5-4768-b783-e0a3b7fbb442 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:30.248428 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-046c7bac-73b1-445f-8185-bca1451741ec req-c8826552-ccd5-4768-b783-e0a3b7fbb442 service nova] Creating event network-vif-plugged:342c12f2-654f-4608-be83-59dbef84ae43 for instance d95c0294-3423-429b-8bcf-43e2089fca23 on hv-cinder-85001 Jul 15 15:27:30.256289 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-046c7bac-73b1-445f-8185-bca1451741ec req-c8826552-ccd5-4768-b783-e0a3b7fbb442 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053734 Jul 15 15:27:30.257552 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 76/153] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:27:30.266076 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3fce3d2f-e24c-42d2-b4b7-57ad841a41c7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:30.267335 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-3fce3d2f-e24c-42d2-b4b7-57ad841a41c7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:30.278178 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3fce3d2f-e24c-42d2-b4b7-57ad841a41c7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:30.279383 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3fce3d2f-e24c-42d2-b4b7-57ad841a41c7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:30.280322 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3fce3d2f-e24c-42d2-b4b7-57ad841a41c7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:30.280766 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3fce3d2f-e24c-42d2-b4b7-57ad841a41c7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:30.282443 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ad2fb8c3-ffc5-4f0c-bbdc-2e6f6ad12d59 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:30.296286 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ad2fb8c3-ffc5-4f0c-bbdc-2e6f6ad12d59 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.537222 Jul 15 15:27:30.297990 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 78/154] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:29 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:30.548821 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3fce3d2f-e24c-42d2-b4b7-57ad841a41c7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:30.560041 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3fce3d2f-e24c-42d2-b4b7-57ad841a41c7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:30.561750 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3fce3d2f-e24c-42d2-b4b7-57ad841a41c7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:30.563150 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-3fce3d2f-e24c-42d2-b4b7-57ad841a41c7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.304153 Jul 15 15:27:30.563848 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 77/155] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:30 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:27:30.795907 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-61733b11-16fa-4091-aeb8-cf720f452b52 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:30.797640 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-61733b11-16fa-4091-aeb8-cf720f452b52 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:30.809654 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-61733b11-16fa-4091-aeb8-cf720f452b52 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:30.810303 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-61733b11-16fa-4091-aeb8-cf720f452b52 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:30.811646 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-61733b11-16fa-4091-aeb8-cf720f452b52 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:30.812580 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-61733b11-16fa-4091-aeb8-cf720f452b52 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:31.067650 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-61733b11-16fa-4091-aeb8-cf720f452b52 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:31.082834 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-61733b11-16fa-4091-aeb8-cf720f452b52 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.299882 Jul 15 15:27:31.084625 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 79/156] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:30 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:31.225970 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-207f596a-87b3-41df-b41b-fd62ef6977d7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:31.226846 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-207f596a-87b3-41df-b41b-fd62ef6977d7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:31.237505 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-207f596a-87b3-41df-b41b-fd62ef6977d7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:31.237971 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-207f596a-87b3-41df-b41b-fd62ef6977d7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:31.238761 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-207f596a-87b3-41df-b41b-fd62ef6977d7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:31.239252 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-207f596a-87b3-41df-b41b-fd62ef6977d7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:31.326185 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-caa6d93c-8cc3-4837-9e97-c97a8e816598 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:31.327053 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-caa6d93c-8cc3-4837-9e97-c97a8e816598 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:31.334001 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-caa6d93c-8cc3-4837-9e97-c97a8e816598 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:31.334437 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-caa6d93c-8cc3-4837-9e97-c97a8e816598 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:31.335479 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-caa6d93c-8cc3-4837-9e97-c97a8e816598 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:31.335910 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-caa6d93c-8cc3-4837-9e97-c97a8e816598 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:31.530503 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-207f596a-87b3-41df-b41b-fd62ef6977d7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:31.550300 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-207f596a-87b3-41df-b41b-fd62ef6977d7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 0.327827 Jul 15 15:27:31.551356 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 78/157] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:31 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:31.590361 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-c24734c7-38e2-4889-ad12-6777c520526b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:31.590991 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-c24734c7-38e2-4889-ad12-6777c520526b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:31.601667 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c24734c7-38e2-4889-ad12-6777c520526b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:31.602472 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c24734c7-38e2-4889-ad12-6777c520526b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:31.602874 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-caa6d93c-8cc3-4837-9e97-c97a8e816598 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:31.603897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c24734c7-38e2-4889-ad12-6777c520526b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:31.604675 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c24734c7-38e2-4889-ad12-6777c520526b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:31.612577 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=100 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:31.615316 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-caa6d93c-8cc3-4837-9e97-c97a8e816598 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.293064 Jul 15 15:27:31.616322 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 80/158] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:31 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:31.788318 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-c24734c7-38e2-4889-ad12-6777c520526b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:31.798737 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-c24734c7-38e2-4889-ad12-6777c520526b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:31.800337 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-c24734c7-38e2-4889-ad12-6777c520526b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:31.801812 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-c24734c7-38e2-4889-ad12-6777c520526b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.217340 Jul 15 15:27:31.804847 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 79/159] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:31 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:27:32.110121 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-31d76e54-dcf6-4c43-9fd7-80547daae263 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:32.110758 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-31d76e54-dcf6-4c43-9fd7-80547daae263 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:32.121880 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-31d76e54-dcf6-4c43-9fd7-80547daae263 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:32.122655 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-31d76e54-dcf6-4c43-9fd7-80547daae263 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:32.123590 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-31d76e54-dcf6-4c43-9fd7-80547daae263 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:32.124311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-31d76e54-dcf6-4c43-9fd7-80547daae263 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:32.362631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-31d76e54-dcf6-4c43-9fd7-80547daae263 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:32.373621 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-31d76e54-dcf6-4c43-9fd7-80547daae263 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.270225 Jul 15 15:27:32.374190 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 81/160] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:32 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:32.576282 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3d263ce8-acc6-460d-bb5c-fe016253396e tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:32.577150 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-3d263ce8-acc6-460d-bb5c-fe016253396e tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:32.583593 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3d263ce8-acc6-460d-bb5c-fe016253396e tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:32.584020 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3d263ce8-acc6-460d-bb5c-fe016253396e tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:32.584962 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3d263ce8-acc6-460d-bb5c-fe016253396e tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:32.585387 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3d263ce8-acc6-460d-bb5c-fe016253396e tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:32.642645 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-76aa62c4-29d6-475e-b415-23d14bcb12cd tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:32.643348 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-76aa62c4-29d6-475e-b415-23d14bcb12cd tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:32.670989 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-76aa62c4-29d6-475e-b415-23d14bcb12cd tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:32.671837 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-76aa62c4-29d6-475e-b415-23d14bcb12cd tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:32.672642 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-76aa62c4-29d6-475e-b415-23d14bcb12cd tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:32.673087 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-76aa62c4-29d6-475e-b415-23d14bcb12cd tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:32.881829 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3d263ce8-acc6-460d-bb5c-fe016253396e tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:32.892776 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-3d263ce8-acc6-460d-bb5c-fe016253396e tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 0.320051 Jul 15 15:27:32.893837 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 80/161] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:32 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:32.900397 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-66ef38df-1f0e-4c2b-a4b0-5b9f615573c8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:32.901563 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-66ef38df-1f0e-4c2b-a4b0-5b9f615573c8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:32.908653 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-66ef38df-1f0e-4c2b-a4b0-5b9f615573c8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:32.909098 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-66ef38df-1f0e-4c2b-a4b0-5b9f615573c8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:32.910318 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-66ef38df-1f0e-4c2b-a4b0-5b9f615573c8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:32.911050 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-66ef38df-1f0e-4c2b-a4b0-5b9f615573c8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:32.952786 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-76aa62c4-29d6-475e-b415-23d14bcb12cd tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:32.972394 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-76aa62c4-29d6-475e-b415-23d14bcb12cd tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.334096 Jul 15 15:27:32.973167 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 82/162] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:32 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:27:33.134066 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-66ef38df-1f0e-4c2b-a4b0-5b9f615573c8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:33.145694 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-66ef38df-1f0e-4c2b-a4b0-5b9f615573c8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:33.148108 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-66ef38df-1f0e-4c2b-a4b0-5b9f615573c8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:33.149568 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-66ef38df-1f0e-4c2b-a4b0-5b9f615573c8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.254254 Jul 15 15:27:33.150284 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 81/163] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:32 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:27:33.404360 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4f8eacae-c906-4dc7-b7cc-2b7a3507a3e5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:33.405883 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-4f8eacae-c906-4dc7-b7cc-2b7a3507a3e5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:33.417578 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4f8eacae-c906-4dc7-b7cc-2b7a3507a3e5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:33.418335 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4f8eacae-c906-4dc7-b7cc-2b7a3507a3e5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:33.429269 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4f8eacae-c906-4dc7-b7cc-2b7a3507a3e5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:33.429857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4f8eacae-c906-4dc7-b7cc-2b7a3507a3e5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:33.436409 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=100 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:33.665210 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-4f8eacae-c906-4dc7-b7cc-2b7a3507a3e5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:33.674720 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4f8eacae-c906-4dc7-b7cc-2b7a3507a3e5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.275693 Jul 15 15:27:33.675354 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 83/164] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:33 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:33.914207 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-2dec86f2-aeae-4642-acac-7e09f4a5402d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:33.917719 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-2dec86f2-aeae-4642-acac-7e09f4a5402d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:33.939525 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2dec86f2-aeae-4642-acac-7e09f4a5402d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:33.940444 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2dec86f2-aeae-4642-acac-7e09f4a5402d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:33.941794 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2dec86f2-aeae-4642-acac-7e09f4a5402d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:33.942568 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2dec86f2-aeae-4642-acac-7e09f4a5402d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:33.999676 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f3d2535a-a9fc-41e6-ac14-49aacbf65efb tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:34.000693 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f3d2535a-a9fc-41e6-ac14-49aacbf65efb tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:34.007456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f3d2535a-a9fc-41e6-ac14-49aacbf65efb tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:34.007886 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f3d2535a-a9fc-41e6-ac14-49aacbf65efb tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:34.008654 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f3d2535a-a9fc-41e6-ac14-49aacbf65efb tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:34.009071 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f3d2535a-a9fc-41e6-ac14-49aacbf65efb tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:34.214135 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-2dec86f2-aeae-4642-acac-7e09f4a5402d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:34.226907 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-2dec86f2-aeae-4642-acac-7e09f4a5402d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 0.316548 Jul 15 15:27:34.230041 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 82/165] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:33 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:34.235431 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-00826dd0-84eb-434d-b30b-e7dc17c68b6d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:34.236435 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-00826dd0-84eb-434d-b30b-e7dc17c68b6d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:34.255327 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-00826dd0-84eb-434d-b30b-e7dc17c68b6d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:34.255909 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-00826dd0-84eb-434d-b30b-e7dc17c68b6d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:34.257007 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-00826dd0-84eb-434d-b30b-e7dc17c68b6d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:34.257571 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-00826dd0-84eb-434d-b30b-e7dc17c68b6d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:34.279636 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f3d2535a-a9fc-41e6-ac14-49aacbf65efb tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:34.293763 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f3d2535a-a9fc-41e6-ac14-49aacbf65efb tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.298021 Jul 15 15:27:34.294800 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 84/166] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:33 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:27:34.696481 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-00826dd0-84eb-434d-b30b-e7dc17c68b6d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:34.698123 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a10efd60-e380-4ee3-a59e-7881d76ea4a0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:34.699508 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a10efd60-e380-4ee3-a59e-7881d76ea4a0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:34.705516 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-00826dd0-84eb-434d-b30b-e7dc17c68b6d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:34.707068 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-00826dd0-84eb-434d-b30b-e7dc17c68b6d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:34.708649 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-00826dd0-84eb-434d-b30b-e7dc17c68b6d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.479926 Jul 15 15:27:34.709575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 83/167] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:34 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:27:34.710561 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a10efd60-e380-4ee3-a59e-7881d76ea4a0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:34.711272 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a10efd60-e380-4ee3-a59e-7881d76ea4a0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:34.712488 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a10efd60-e380-4ee3-a59e-7881d76ea4a0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:34.713179 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a10efd60-e380-4ee3-a59e-7881d76ea4a0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:34.872354 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a10efd60-e380-4ee3-a59e-7881d76ea4a0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:34.880783 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a10efd60-e380-4ee3-a59e-7881d76ea4a0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.189238 Jul 15 15:27:34.881439 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 85/168] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:34 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:27:35.251954 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-02e31522-7a2f-4a94-8d85-730ec73a843c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:35.252553 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-02e31522-7a2f-4a94-8d85-730ec73a843c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:35.258897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-02e31522-7a2f-4a94-8d85-730ec73a843c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:35.259337 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-02e31522-7a2f-4a94-8d85-730ec73a843c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:35.260092 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-02e31522-7a2f-4a94-8d85-730ec73a843c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:35.260514 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-02e31522-7a2f-4a94-8d85-730ec73a843c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:35.337507 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6b4e09ef-9f05-4175-9b63-6dcc9e75f5ea tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:35.338608 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6b4e09ef-9f05-4175-9b63-6dcc9e75f5ea tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:35.349302 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6b4e09ef-9f05-4175-9b63-6dcc9e75f5ea tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:35.350102 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6b4e09ef-9f05-4175-9b63-6dcc9e75f5ea tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:35.351490 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6b4e09ef-9f05-4175-9b63-6dcc9e75f5ea tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:35.352215 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6b4e09ef-9f05-4175-9b63-6dcc9e75f5ea tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:35.468940 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-02e31522-7a2f-4a94-8d85-730ec73a843c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:35.479530 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-02e31522-7a2f-4a94-8d85-730ec73a843c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 0.230506 Jul 15 15:27:35.479530 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 84/169] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:35 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:35.548937 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6b4e09ef-9f05-4175-9b63-6dcc9e75f5ea tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:35.558455 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6b4e09ef-9f05-4175-9b63-6dcc9e75f5ea tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.228049 Jul 15 15:27:35.559829 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 86/170] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:35 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:35.728474 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-7d8f422c-9dd4-4cc9-86b6-b78ae883e16f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:35.728993 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-7d8f422c-9dd4-4cc9-86b6-b78ae883e16f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:35.736351 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7d8f422c-9dd4-4cc9-86b6-b78ae883e16f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:35.736876 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7d8f422c-9dd4-4cc9-86b6-b78ae883e16f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:35.737648 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7d8f422c-9dd4-4cc9-86b6-b78ae883e16f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:35.738064 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7d8f422c-9dd4-4cc9-86b6-b78ae883e16f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:35.900278 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b3cb3048-c386-4d98-9d9e-0015ffa8371c tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:35.901034 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b3cb3048-c386-4d98-9d9e-0015ffa8371c tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:35.901677 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-7d8f422c-9dd4-4cc9-86b6-b78ae883e16f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:35.909492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b3cb3048-c386-4d98-9d9e-0015ffa8371c tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:35.910183 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b3cb3048-c386-4d98-9d9e-0015ffa8371c tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:35.911469 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b3cb3048-c386-4d98-9d9e-0015ffa8371c tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:35.912156 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b3cb3048-c386-4d98-9d9e-0015ffa8371c tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:35.917061 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-7d8f422c-9dd4-4cc9-86b6-b78ae883e16f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:35.919449 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-7d8f422c-9dd4-4cc9-86b6-b78ae883e16f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:35.920915 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-7d8f422c-9dd4-4cc9-86b6-b78ae883e16f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.196391 Jul 15 15:27:35.922025 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 85/171] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:35 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:27:36.112179 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b3cb3048-c386-4d98-9d9e-0015ffa8371c tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:36.121307 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b3cb3048-c386-4d98-9d9e-0015ffa8371c tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.225290 Jul 15 15:27:36.121931 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 87/172] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:35 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:27:36.505692 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-8af59c7e-42cb-4064-be92-10dadbd527fe tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:36.506844 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-8af59c7e-42cb-4064-be92-10dadbd527fe tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:36.515693 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8af59c7e-42cb-4064-be92-10dadbd527fe tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:36.516277 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8af59c7e-42cb-4064-be92-10dadbd527fe tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:36.517120 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8af59c7e-42cb-4064-be92-10dadbd527fe tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:36.517538 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8af59c7e-42cb-4064-be92-10dadbd527fe tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:36.586197 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7aa1744e-18e2-4aa6-81b7-25ba207defd8 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:36.587159 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7aa1744e-18e2-4aa6-81b7-25ba207defd8 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:36.602348 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7aa1744e-18e2-4aa6-81b7-25ba207defd8 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:36.602842 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7aa1744e-18e2-4aa6-81b7-25ba207defd8 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:36.603605 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7aa1744e-18e2-4aa6-81b7-25ba207defd8 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:36.604032 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7aa1744e-18e2-4aa6-81b7-25ba207defd8 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:36.841002 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-8af59c7e-42cb-4064-be92-10dadbd527fe tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:36.853639 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-8af59c7e-42cb-4064-be92-10dadbd527fe tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 0.354966 Jul 15 15:27:36.855000 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 86/173] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:36 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:36.878247 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7aa1744e-18e2-4aa6-81b7-25ba207defd8 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:36.892846 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7aa1744e-18e2-4aa6-81b7-25ba207defd8 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.312322 Jul 15 15:27:36.894048 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 88/174] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:36 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:36.955629 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-a82376a2-a953-4e10-9f12-f172f7d97280 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:36.955629 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-a82376a2-a953-4e10-9f12-f172f7d97280 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:36.965548 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a82376a2-a953-4e10-9f12-f172f7d97280 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:36.966272 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a82376a2-a953-4e10-9f12-f172f7d97280 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:36.967591 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a82376a2-a953-4e10-9f12-f172f7d97280 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:36.968413 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a82376a2-a953-4e10-9f12-f172f7d97280 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:37.142717 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-dc1d92f8-22cb-4db0-b0fe-b1e5d7f97b71 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:37.144935 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-dc1d92f8-22cb-4db0-b0fe-b1e5d7f97b71 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:37.158232 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dc1d92f8-22cb-4db0-b0fe-b1e5d7f97b71 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:37.159651 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dc1d92f8-22cb-4db0-b0fe-b1e5d7f97b71 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:37.164075 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dc1d92f8-22cb-4db0-b0fe-b1e5d7f97b71 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:37.164865 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dc1d92f8-22cb-4db0-b0fe-b1e5d7f97b71 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:37.188893 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-a82376a2-a953-4e10-9f12-f172f7d97280 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:37.205477 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-a82376a2-a953-4e10-9f12-f172f7d97280 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:37.209012 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-a82376a2-a953-4e10-9f12-f172f7d97280 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:37.211692 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-a82376a2-a953-4e10-9f12-f172f7d97280 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.265686 Jul 15 15:27:37.212778 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 87/175] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:36 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:27:37.341263 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-dc1d92f8-22cb-4db0-b0fe-b1e5d7f97b71 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:37.349529 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-dc1d92f8-22cb-4db0-b0fe-b1e5d7f97b71 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.213741 Jul 15 15:27:37.350722 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 89/176] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:37 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:27:37.886171 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3aa77662-8166-44af-b599-a7d356a03900 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:37.887167 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-3aa77662-8166-44af-b599-a7d356a03900 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:37.898564 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3aa77662-8166-44af-b599-a7d356a03900 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:37.899433 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3aa77662-8166-44af-b599-a7d356a03900 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:37.900829 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3aa77662-8166-44af-b599-a7d356a03900 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:37.901661 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3aa77662-8166-44af-b599-a7d356a03900 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:37.926917 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-63181aa5-305b-44a1-ab65-83cbce90ce80 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:37.928659 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-63181aa5-305b-44a1-ab65-83cbce90ce80 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:37.939229 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-63181aa5-305b-44a1-ab65-83cbce90ce80 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:37.940163 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-63181aa5-305b-44a1-ab65-83cbce90ce80 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:37.941845 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-63181aa5-305b-44a1-ab65-83cbce90ce80 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:37.942745 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-63181aa5-305b-44a1-ab65-83cbce90ce80 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:38.187002 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3aa77662-8166-44af-b599-a7d356a03900 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:38.204065 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-3aa77662-8166-44af-b599-a7d356a03900 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 0.327918 Jul 15 15:27:38.206334 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 88/177] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:37 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:38.215010 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-63181aa5-305b-44a1-ab65-83cbce90ce80 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:38.230140 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-63181aa5-305b-44a1-ab65-83cbce90ce80 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.312727 Jul 15 15:27:38.231934 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 90/178] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:37 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:38.240858 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-f06fce95-cfa9-4138-9411-35d303a0f1b4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:38.241951 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-f06fce95-cfa9-4138-9411-35d303a0f1b4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:38.250447 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f06fce95-cfa9-4138-9411-35d303a0f1b4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:38.251396 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f06fce95-cfa9-4138-9411-35d303a0f1b4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:38.252323 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f06fce95-cfa9-4138-9411-35d303a0f1b4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:38.253108 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f06fce95-cfa9-4138-9411-35d303a0f1b4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:38.371817 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-aaddbe1d-e412-4c62-8836-9ea794d316ae tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:38.372857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-aaddbe1d-e412-4c62-8836-9ea794d316ae tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:38.383730 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aaddbe1d-e412-4c62-8836-9ea794d316ae tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:38.384506 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aaddbe1d-e412-4c62-8836-9ea794d316ae tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:38.385853 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aaddbe1d-e412-4c62-8836-9ea794d316ae tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:38.386636 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aaddbe1d-e412-4c62-8836-9ea794d316ae tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:38.430368 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f06fce95-cfa9-4138-9411-35d303a0f1b4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:38.443575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f06fce95-cfa9-4138-9411-35d303a0f1b4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:38.444965 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f06fce95-cfa9-4138-9411-35d303a0f1b4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:38.446215 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-f06fce95-cfa9-4138-9411-35d303a0f1b4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.210862 Jul 15 15:27:38.446863 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 89/179] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:38 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:27:38.578251 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-aaddbe1d-e412-4c62-8836-9ea794d316ae tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:38.585892 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-aaddbe1d-e412-4c62-8836-9ea794d316ae tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.220842 Jul 15 15:27:38.586655 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 91/180] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:38 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:39.248624 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-7bbc3e80-8254-4515-be3c-56678b53fc30 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:39.252071 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-7bbc3e80-8254-4515-be3c-56678b53fc30 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:39.254740 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a699e772-6d57-4653-a35b-3417b5586309 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:39.255725 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a699e772-6d57-4653-a35b-3417b5586309 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:39.262225 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7bbc3e80-8254-4515-be3c-56678b53fc30 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:39.263132 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7bbc3e80-8254-4515-be3c-56678b53fc30 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:39.264023 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a699e772-6d57-4653-a35b-3417b5586309 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:39.264518 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7bbc3e80-8254-4515-be3c-56678b53fc30 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:39.264741 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a699e772-6d57-4653-a35b-3417b5586309 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:39.265909 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a699e772-6d57-4653-a35b-3417b5586309 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:39.266587 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a699e772-6d57-4653-a35b-3417b5586309 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:39.266871 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7bbc3e80-8254-4515-be3c-56678b53fc30 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:39.613407 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a699e772-6d57-4653-a35b-3417b5586309 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:39.617786 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-7bbc3e80-8254-4515-be3c-56678b53fc30 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:39.627130 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-7bbc3e80-8254-4515-be3c-56678b53fc30 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 0.384756 Jul 15 15:27:39.628578 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 90/181] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:39 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:39.631343 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a699e772-6d57-4653-a35b-3417b5586309 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.381428 Jul 15 15:27:39.631343 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 92/182] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:39 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:27:39.635373 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-e89dc654-d860-49d4-b55a-346da66df3f2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:39.636567 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-e89dc654-d860-49d4-b55a-346da66df3f2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:39.645819 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6deed0bc-b7f5-4e99-a910-3e417fd84e48 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:39.647230 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6deed0bc-b7f5-4e99-a910-3e417fd84e48 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:39.654730 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e89dc654-d860-49d4-b55a-346da66df3f2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:39.654730 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e89dc654-d860-49d4-b55a-346da66df3f2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:39.655661 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e89dc654-d860-49d4-b55a-346da66df3f2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:39.658202 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e89dc654-d860-49d4-b55a-346da66df3f2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:39.665059 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6deed0bc-b7f5-4e99-a910-3e417fd84e48 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:39.665773 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6deed0bc-b7f5-4e99-a910-3e417fd84e48 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:39.667137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6deed0bc-b7f5-4e99-a910-3e417fd84e48 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:39.668014 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6deed0bc-b7f5-4e99-a910-3e417fd84e48 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:39.965638 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e89dc654-d860-49d4-b55a-346da66df3f2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:39.971931 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6deed0bc-b7f5-4e99-a910-3e417fd84e48 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:39.981527 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e89dc654-d860-49d4-b55a-346da66df3f2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:39.983772 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6deed0bc-b7f5-4e99-a910-3e417fd84e48 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.349753 Jul 15 15:27:39.984877 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 93/183] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:39 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:39.985096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e89dc654-d860-49d4-b55a-346da66df3f2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:39.986441 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-e89dc654-d860-49d4-b55a-346da66df3f2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.356619 Jul 15 15:27:39.987384 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 91/184] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:39 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:27:40.660944 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e95f6433-712f-440b-8ebf-f95cfb684051 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:40.661713 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-a9e45593-cb1d-4a9a-85a7-e21ef8ad1f93 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:40.662315 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e95f6433-712f-440b-8ebf-f95cfb684051 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:40.662480 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-a9e45593-cb1d-4a9a-85a7-e21ef8ad1f93 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:40.672786 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a9e45593-cb1d-4a9a-85a7-e21ef8ad1f93 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:40.673116 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e95f6433-712f-440b-8ebf-f95cfb684051 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:40.673528 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a9e45593-cb1d-4a9a-85a7-e21ef8ad1f93 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:40.673834 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e95f6433-712f-440b-8ebf-f95cfb684051 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:40.674734 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e95f6433-712f-440b-8ebf-f95cfb684051 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:40.674920 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a9e45593-cb1d-4a9a-85a7-e21ef8ad1f93 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:40.675365 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e95f6433-712f-440b-8ebf-f95cfb684051 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:40.675527 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a9e45593-cb1d-4a9a-85a7-e21ef8ad1f93 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:41.064291 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e95f6433-712f-440b-8ebf-f95cfb684051 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:41.073260 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e95f6433-712f-440b-8ebf-f95cfb684051 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.420220 Jul 15 15:27:41.074344 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 94/185] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:40 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:41.079898 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-98919641-311d-4c83-903f-cd97008153a8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:41.080469 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-a9e45593-cb1d-4a9a-85a7-e21ef8ad1f93 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:41.080892 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-98919641-311d-4c83-903f-cd97008153a8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:41.090572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-98919641-311d-4c83-903f-cd97008153a8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:41.091606 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-98919641-311d-4c83-903f-cd97008153a8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:41.093005 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-98919641-311d-4c83-903f-cd97008153a8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:41.093644 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-a9e45593-cb1d-4a9a-85a7-e21ef8ad1f93 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 0.439432 Jul 15 15:27:41.093871 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-98919641-311d-4c83-903f-cd97008153a8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:41.094870 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 92/186] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:40 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:27:41.099678 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-98887e25-d8d5-4066-bf48-834074660a7c tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:41.100282 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-98887e25-d8d5-4066-bf48-834074660a7c tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:41.106554 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-98887e25-d8d5-4066-bf48-834074660a7c tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:41.107193 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-98887e25-d8d5-4066-bf48-834074660a7c tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:41.108186 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-98887e25-d8d5-4066-bf48-834074660a7c tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:41.109617 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-98887e25-d8d5-4066-bf48-834074660a7c tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:41.373256 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-98919641-311d-4c83-903f-cd97008153a8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:41.380073 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-98887e25-d8d5-4066-bf48-834074660a7c tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:41.393885 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-98919641-311d-4c83-903f-cd97008153a8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:41.395961 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-98919641-311d-4c83-903f-cd97008153a8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:41.397040 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-98919641-311d-4c83-903f-cd97008153a8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.321517 Jul 15 15:27:41.398085 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 95/187] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:41 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:27:41.402637 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-98887e25-d8d5-4066-bf48-834074660a7c tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.306820 Jul 15 15:27:41.411417 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 93/188] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:41 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:42.106370 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7ac696c2-e26b-4e17-a389-8016bdd0002c tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:42.107298 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7ac696c2-e26b-4e17-a389-8016bdd0002c tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:42.121621 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-6e703c9b-1da4-447e-96ae-6337a7040316 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:42.123012 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-6e703c9b-1da4-447e-96ae-6337a7040316 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:42.136464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7ac696c2-e26b-4e17-a389-8016bdd0002c tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:42.136464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7ac696c2-e26b-4e17-a389-8016bdd0002c tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:42.136731 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7ac696c2-e26b-4e17-a389-8016bdd0002c tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:42.137057 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7ac696c2-e26b-4e17-a389-8016bdd0002c tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:42.152685 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6e703c9b-1da4-447e-96ae-6337a7040316 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:42.153868 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6e703c9b-1da4-447e-96ae-6337a7040316 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:42.154496 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6e703c9b-1da4-447e-96ae-6337a7040316 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:42.155245 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6e703c9b-1da4-447e-96ae-6337a7040316 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:42.550303 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7ac696c2-e26b-4e17-a389-8016bdd0002c tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:42.558777 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6e703c9b-1da4-447e-96ae-6337a7040316 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:42.565217 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7ac696c2-e26b-4e17-a389-8016bdd0002c tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.463544 Jul 15 15:27:42.566219 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 96/189] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:42 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:42.574976 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0d93a4f1-7ca3-4236-bb9a-7fc2788afe65 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:42.575457 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-6e703c9b-1da4-447e-96ae-6337a7040316 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 0.460410 Jul 15 15:27:42.576556 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-0d93a4f1-7ca3-4236-bb9a-7fc2788afe65 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:42.594750 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 94/190] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:42 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:42.600825 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-2f219fb6-26e2-4359-8d15-dd0ab37213b1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:42.602046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-2f219fb6-26e2-4359-8d15-dd0ab37213b1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:42.609134 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0d93a4f1-7ca3-4236-bb9a-7fc2788afe65 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:42.610394 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0d93a4f1-7ca3-4236-bb9a-7fc2788afe65 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:42.612254 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0d93a4f1-7ca3-4236-bb9a-7fc2788afe65 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:42.612840 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2f219fb6-26e2-4359-8d15-dd0ab37213b1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:42.612975 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0d93a4f1-7ca3-4236-bb9a-7fc2788afe65 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:42.613621 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2f219fb6-26e2-4359-8d15-dd0ab37213b1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:42.614810 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2f219fb6-26e2-4359-8d15-dd0ab37213b1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:42.615531 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2f219fb6-26e2-4359-8d15-dd0ab37213b1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:42.971465 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-2f219fb6-26e2-4359-8d15-dd0ab37213b1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:42.982880 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=100 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:42.983160 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0d93a4f1-7ca3-4236-bb9a-7fc2788afe65 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:42.990844 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-2f219fb6-26e2-4359-8d15-dd0ab37213b1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.411851 Jul 15 15:27:43.002599 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 95/191] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:42 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:43.003480 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0d93a4f1-7ca3-4236-bb9a-7fc2788afe65 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:43.006795 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0d93a4f1-7ca3-4236-bb9a-7fc2788afe65 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:43.009078 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-0d93a4f1-7ca3-4236-bb9a-7fc2788afe65 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.440754 Jul 15 15:27:43.023291 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 97/192] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:42 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:27:43.609714 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-531e78f1-8a4d-4198-9e58-526cc45e40a5 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:43.610416 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3c713691-eb39-44ae-accc-0e8bb8f7ecab tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:43.610416 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3c713691-eb39-44ae-accc-0e8bb8f7ecab tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:43.611393 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-531e78f1-8a4d-4198-9e58-526cc45e40a5 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:43.633777 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3c713691-eb39-44ae-accc-0e8bb8f7ecab tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:43.633777 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3c713691-eb39-44ae-accc-0e8bb8f7ecab tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:43.640842 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3c713691-eb39-44ae-accc-0e8bb8f7ecab tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:43.640842 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3c713691-eb39-44ae-accc-0e8bb8f7ecab tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:43.642159 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-531e78f1-8a4d-4198-9e58-526cc45e40a5 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:43.643615 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-531e78f1-8a4d-4198-9e58-526cc45e40a5 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:43.654241 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-531e78f1-8a4d-4198-9e58-526cc45e40a5 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:43.654241 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-531e78f1-8a4d-4198-9e58-526cc45e40a5 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:44.079992 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-531e78f1-8a4d-4198-9e58-526cc45e40a5 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:44.095487 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-531e78f1-8a4d-4198-9e58-526cc45e40a5 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.504342 Jul 15 15:27:44.102870 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 96/193] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:43 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:44.112543 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-f26f273e-849a-4044-a2ee-4befe6a52ced tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:44.113165 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-f26f273e-849a-4044-a2ee-4befe6a52ced tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:44.136271 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f26f273e-849a-4044-a2ee-4befe6a52ced tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:44.137004 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f26f273e-849a-4044-a2ee-4befe6a52ced tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:44.142424 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f26f273e-849a-4044-a2ee-4befe6a52ced tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:44.142424 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f26f273e-849a-4044-a2ee-4befe6a52ced tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:44.205758 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3c713691-eb39-44ae-accc-0e8bb8f7ecab tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:44.225993 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3c713691-eb39-44ae-accc-0e8bb8f7ecab tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 0.624354 Jul 15 15:27:44.229305 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 98/194] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:43 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:44.241334 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-349786fe-e526-4556-ba54-2d9c6eeb1c0c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:44.242305 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-349786fe-e526-4556-ba54-2d9c6eeb1c0c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:44.260826 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-349786fe-e526-4556-ba54-2d9c6eeb1c0c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:44.266043 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-349786fe-e526-4556-ba54-2d9c6eeb1c0c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:44.269415 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-349786fe-e526-4556-ba54-2d9c6eeb1c0c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:44.271973 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-349786fe-e526-4556-ba54-2d9c6eeb1c0c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:44.556954 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f26f273e-849a-4044-a2ee-4befe6a52ced tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:44.604172 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-f26f273e-849a-4044-a2ee-4befe6a52ced tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.496976 Jul 15 15:27:44.605481 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 97/195] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:44 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:44.613158 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-afad65d4-fc1a-4894-818e-840554b893c2 req-e89097e1-f8c1-46da-a4a6-ae3bea063aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3291b90a-688c-40b9-ba4e-ef4a6ac4beb0", "name": "network-vif-plugged", "status": "completed", "tag": "a5206037-9d2c-4d13-a70b-abb42f166a9f"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:27:44.628516 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-afad65d4-fc1a-4894-818e-840554b893c2 req-e89097e1-f8c1-46da-a4a6-ae3bea063aa7 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:44.629214 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-afad65d4-fc1a-4894-818e-840554b893c2 req-e89097e1-f8c1-46da-a4a6-ae3bea063aa7 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:44.644922 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-afad65d4-fc1a-4894-818e-840554b893c2 req-e89097e1-f8c1-46da-a4a6-ae3bea063aa7 service nova] Creating event network-vif-plugged:a5206037-9d2c-4d13-a70b-abb42f166a9f for instance 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 on hv-cinder-85001 Jul 15 15:27:44.652854 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-afad65d4-fc1a-4894-818e-840554b893c2 req-e89097e1-f8c1-46da-a4a6-ae3bea063aa7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044513 Jul 15 15:27:44.654131 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 98/196] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:27:44.679148 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-349786fe-e526-4556-ba54-2d9c6eeb1c0c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:44.682627 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=100 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:44.695237 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-349786fe-e526-4556-ba54-2d9c6eeb1c0c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:44.698492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-349786fe-e526-4556-ba54-2d9c6eeb1c0c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:44.700567 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-349786fe-e526-4556-ba54-2d9c6eeb1c0c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.469470 Jul 15 15:27:44.701867 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 99/197] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:44 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:27:45.126321 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-4a54c3d7-5d04-4b06-b0df-f2d3a3a3665e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:45.127040 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-4a54c3d7-5d04-4b06-b0df-f2d3a3a3665e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:45.133722 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4a54c3d7-5d04-4b06-b0df-f2d3a3a3665e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:45.134149 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4a54c3d7-5d04-4b06-b0df-f2d3a3a3665e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:45.134960 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4a54c3d7-5d04-4b06-b0df-f2d3a3a3665e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:45.135388 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4a54c3d7-5d04-4b06-b0df-f2d3a3a3665e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:45.259059 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b953dbc5-25db-49c6-958d-35872e20a441 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:45.261677 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b953dbc5-25db-49c6-958d-35872e20a441 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:45.271237 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b953dbc5-25db-49c6-958d-35872e20a441 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:45.271818 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b953dbc5-25db-49c6-958d-35872e20a441 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:45.272678 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b953dbc5-25db-49c6-958d-35872e20a441 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:45.273228 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b953dbc5-25db-49c6-958d-35872e20a441 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:45.344580 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-4a54c3d7-5d04-4b06-b0df-f2d3a3a3665e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:45.380493 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-4a54c3d7-5d04-4b06-b0df-f2d3a3a3665e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.250089 Jul 15 15:27:45.381542 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 99/198] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:45 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:45.510253 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b953dbc5-25db-49c6-958d-35872e20a441 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:45.520498 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b953dbc5-25db-49c6-958d-35872e20a441 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 0.269042 Jul 15 15:27:45.521754 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 100/199] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:45 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:45.641083 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-0b697be3-9f1b-450d-a2cd-902f38f7fbba tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:45.642626 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-0b697be3-9f1b-450d-a2cd-902f38f7fbba tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:45.653370 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0b697be3-9f1b-450d-a2cd-902f38f7fbba tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:45.654598 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0b697be3-9f1b-450d-a2cd-902f38f7fbba tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:45.656358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0b697be3-9f1b-450d-a2cd-902f38f7fbba tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:45.657655 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0b697be3-9f1b-450d-a2cd-902f38f7fbba tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:45.737057 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-dca75627-29bb-45ff-ab7e-9bf549d99544 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:45.739118 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-dca75627-29bb-45ff-ab7e-9bf549d99544 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:45.755807 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dca75627-29bb-45ff-ab7e-9bf549d99544 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:45.756373 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dca75627-29bb-45ff-ab7e-9bf549d99544 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:45.757754 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dca75627-29bb-45ff-ab7e-9bf549d99544 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:45.758417 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dca75627-29bb-45ff-ab7e-9bf549d99544 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:45.990796 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-0b697be3-9f1b-450d-a2cd-902f38f7fbba tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:46.007613 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-0b697be3-9f1b-450d-a2cd-902f38f7fbba tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.372617 Jul 15 15:27:46.011317 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 100/200] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:45 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:27:46.097657 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-dca75627-29bb-45ff-ab7e-9bf549d99544 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:46.109809 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-dca75627-29bb-45ff-ab7e-9bf549d99544 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:46.113059 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-dca75627-29bb-45ff-ab7e-9bf549d99544 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:46.115628 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-dca75627-29bb-45ff-ab7e-9bf549d99544 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1405 microversion: 2.20 time: 0.385447 Jul 15 15:27:46.116657 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 101/201] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:45 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1405 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:27:46.402249 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-d0ee8694-3f70-40a6-b002-1de57d1e772a tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:46.403130 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-d0ee8694-3f70-40a6-b002-1de57d1e772a tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:46.417145 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d0ee8694-3f70-40a6-b002-1de57d1e772a tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:46.418575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d0ee8694-3f70-40a6-b002-1de57d1e772a tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:46.428013 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d0ee8694-3f70-40a6-b002-1de57d1e772a tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:46.428716 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d0ee8694-3f70-40a6-b002-1de57d1e772a tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:46.549334 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-95e08c49-dc95-4cd8-8e00-e95b04c2bb9b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:46.550421 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-95e08c49-dc95-4cd8-8e00-e95b04c2bb9b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:46.567111 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-95e08c49-dc95-4cd8-8e00-e95b04c2bb9b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:46.573609 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-95e08c49-dc95-4cd8-8e00-e95b04c2bb9b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:46.576900 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-95e08c49-dc95-4cd8-8e00-e95b04c2bb9b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:46.580097 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-95e08c49-dc95-4cd8-8e00-e95b04c2bb9b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:46.797647 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-d0ee8694-3f70-40a6-b002-1de57d1e772a tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:46.811080 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-d0ee8694-3f70-40a6-b002-1de57d1e772a tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.413720 Jul 15 15:27:46.813195 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 101/202] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:46 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:46.884102 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-95e08c49-dc95-4cd8-8e00-e95b04c2bb9b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:46.921128 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-95e08c49-dc95-4cd8-8e00-e95b04c2bb9b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 0.382659 Jul 15 15:27:46.934588 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 102/203] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:46 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:47.043118 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-38f45e74-58ea-48f1-bad8-e5c4f8f30e8f tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:47.044287 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-38f45e74-58ea-48f1-bad8-e5c4f8f30e8f tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:47.060352 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-38f45e74-58ea-48f1-bad8-e5c4f8f30e8f tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:47.066225 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-38f45e74-58ea-48f1-bad8-e5c4f8f30e8f tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:47.066915 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-38f45e74-58ea-48f1-bad8-e5c4f8f30e8f tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:47.067390 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-38f45e74-58ea-48f1-bad8-e5c4f8f30e8f tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:47.143698 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-36a6b408-0f8e-4891-b137-63295ca315b0 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:47.144507 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-36a6b408-0f8e-4891-b137-63295ca315b0 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:47.164407 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-36a6b408-0f8e-4891-b137-63295ca315b0 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:47.164922 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-36a6b408-0f8e-4891-b137-63295ca315b0 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:47.165814 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-36a6b408-0f8e-4891-b137-63295ca315b0 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:47.166233 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-36a6b408-0f8e-4891-b137-63295ca315b0 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:47.461132 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-38f45e74-58ea-48f1-bad8-e5c4f8f30e8f tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:47.488322 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-38f45e74-58ea-48f1-bad8-e5c4f8f30e8f tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.453419 Jul 15 15:27:47.492147 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 102/204] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:47 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:47.653953 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-36a6b408-0f8e-4891-b137-63295ca315b0 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:47.678382 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-36a6b408-0f8e-4891-b137-63295ca315b0 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:47.682125 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-36a6b408-0f8e-4891-b137-63295ca315b0 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:47.684365 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-36a6b408-0f8e-4891-b137-63295ca315b0 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1598 microversion: 2.20 time: 0.546526 Jul 15 15:27:47.692432 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 103/205] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:27:47 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1598 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:27:47.723751 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-57a8e124-bed8-4be1-aee7-2c632f00f579 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:47.729503 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-57a8e124-bed8-4be1-aee7-2c632f00f579 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:47.748408 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-57a8e124-bed8-4be1-aee7-2c632f00f579 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:47.759375 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-57a8e124-bed8-4be1-aee7-2c632f00f579 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:47.760316 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-57a8e124-bed8-4be1-aee7-2c632f00f579 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:47.760604 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-57a8e124-bed8-4be1-aee7-2c632f00f579 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:47.840961 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-70fb7c33-b087-42c4-8f35-13e7963424d8 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:47.844221 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-70fb7c33-b087-42c4-8f35-13e7963424d8 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:47.865372 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-70fb7c33-b087-42c4-8f35-13e7963424d8 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:47.866183 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-70fb7c33-b087-42c4-8f35-13e7963424d8 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:47.873394 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-70fb7c33-b087-42c4-8f35-13e7963424d8 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:47.879125 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-70fb7c33-b087-42c4-8f35-13e7963424d8 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:48.275751 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-57a8e124-bed8-4be1-aee7-2c632f00f579 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.561480 Jul 15 15:27:48.277652 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 103/206] 10.222.0.40 () {60 vars in 1315 bytes} [Fri Jul 15 15:27:47 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849/os-interface => generated 285 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:27:48.290816 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-5ac999ac-f4a7-4c78-b6aa-6abbf4c10570 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:48.293973 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-5ac999ac-f4a7-4c78-b6aa-6abbf4c10570 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:48.310812 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-70fb7c33-b087-42c4-8f35-13e7963424d8 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:48.311755 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5ac999ac-f4a7-4c78-b6aa-6abbf4c10570 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:48.313423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5ac999ac-f4a7-4c78-b6aa-6abbf4c10570 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:48.315509 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5ac999ac-f4a7-4c78-b6aa-6abbf4c10570 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:48.316454 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5ac999ac-f4a7-4c78-b6aa-6abbf4c10570 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:48.320393 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-70fb7c33-b087-42c4-8f35-13e7963424d8 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1315 microversion: 2.1 time: 0.487775 Jul 15 15:27:48.331444 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 104/207] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:47 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:48.527852 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-02d074f3-827a-400d-b2b5-6869d2cabd63 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:48.529509 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-02d074f3-827a-400d-b2b5-6869d2cabd63 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:48.552249 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-02d074f3-827a-400d-b2b5-6869d2cabd63 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:48.552968 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-02d074f3-827a-400d-b2b5-6869d2cabd63 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:48.554245 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-02d074f3-827a-400d-b2b5-6869d2cabd63 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:48.554974 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-02d074f3-827a-400d-b2b5-6869d2cabd63 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:48.603545 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-5ac999ac-f4a7-4c78-b6aa-6abbf4c10570 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:48.614379 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-5ac999ac-f4a7-4c78-b6aa-6abbf4c10570 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 0.334980 Jul 15 15:27:48.616120 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 104/208] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:48 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:48.900929 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-02d074f3-827a-400d-b2b5-6869d2cabd63 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:48.914752 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-02d074f3-827a-400d-b2b5-6869d2cabd63 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.398686 Jul 15 15:27:48.916158 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 105/209] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:48 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:27:49.086571 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-a5955581-570b-42c6-b65a-44cae40a41ef req-2a99595d-6f69-4084-a2ad-178bd9a5b556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "021070dd-3943-48b0-a90a-b889e49029ae", "name": "network-vif-plugged", "status": "completed", "tag": "8eaeb63d-dfdc-41da-99f1-1ca36ce2f20f"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:27:49.106806 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-a5955581-570b-42c6-b65a-44cae40a41ef req-2a99595d-6f69-4084-a2ad-178bd9a5b556 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:49.107658 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-a5955581-570b-42c6-b65a-44cae40a41ef req-2a99595d-6f69-4084-a2ad-178bd9a5b556 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:49.126243 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-a5955581-570b-42c6-b65a-44cae40a41ef req-2a99595d-6f69-4084-a2ad-178bd9a5b556 service nova] Creating event network-vif-plugged:8eaeb63d-dfdc-41da-99f1-1ca36ce2f20f for instance 021070dd-3943-48b0-a90a-b889e49029ae on hv-cinder-85001 Jul 15 15:27:49.146612 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-a5955581-570b-42c6-b65a-44cae40a41ef req-2a99595d-6f69-4084-a2ad-178bd9a5b556 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064976 Jul 15 15:27:49.148420 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 105/210] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:27:49.342600 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-41149d18-3949-4958-a14f-a21e8605ef8f tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:49.345797 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-41149d18-3949-4958-a14f-a21e8605ef8f tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:49.354314 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-41149d18-3949-4958-a14f-a21e8605ef8f tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:49.354931 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-41149d18-3949-4958-a14f-a21e8605ef8f tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:49.355803 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-41149d18-3949-4958-a14f-a21e8605ef8f tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:49.356534 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-41149d18-3949-4958-a14f-a21e8605ef8f tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:49.577615 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-41149d18-3949-4958-a14f-a21e8605ef8f tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:49.591506 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-41149d18-3949-4958-a14f-a21e8605ef8f tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1502 microversion: 2.1 time: 0.254150 Jul 15 15:27:49.592392 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 106/211] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:49 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1502 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:49.642795 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-1c5046b4-6a3a-4a80-b1ac-9ca223c08bca tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:49.644106 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-1c5046b4-6a3a-4a80-b1ac-9ca223c08bca tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:49.657825 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1c5046b4-6a3a-4a80-b1ac-9ca223c08bca tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:49.660811 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1c5046b4-6a3a-4a80-b1ac-9ca223c08bca tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:49.661555 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1c5046b4-6a3a-4a80-b1ac-9ca223c08bca tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:49.662633 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1c5046b4-6a3a-4a80-b1ac-9ca223c08bca tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:49.949300 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-874872d9-98aa-40aa-b538-4d9206361a41 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:49.949986 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-874872d9-98aa-40aa-b538-4d9206361a41 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:49.964663 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-874872d9-98aa-40aa-b538-4d9206361a41 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:49.966408 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-874872d9-98aa-40aa-b538-4d9206361a41 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:49.968585 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-874872d9-98aa-40aa-b538-4d9206361a41 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:49.970730 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-874872d9-98aa-40aa-b538-4d9206361a41 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:50.051433 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1c5046b4-6a3a-4a80-b1ac-9ca223c08bca tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:50.084412 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-1c5046b4-6a3a-4a80-b1ac-9ca223c08bca tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 0.451941 Jul 15 15:27:50.098926 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 106/212] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:49 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:50.656793 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-874872d9-98aa-40aa-b538-4d9206361a41 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:50.679265 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-874872d9-98aa-40aa-b538-4d9206361a41 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1362 microversion: 2.1 time: 0.742440 Jul 15 15:27:50.694570 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 107/213] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:49 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1362 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:27:51.123259 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-4ca3d02a-768b-42b5-8b89-ca37d23118b2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:51.124359 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-4ca3d02a-768b-42b5-8b89-ca37d23118b2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:51.167871 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4ca3d02a-768b-42b5-8b89-ca37d23118b2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:51.175591 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4ca3d02a-768b-42b5-8b89-ca37d23118b2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:51.183562 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4ca3d02a-768b-42b5-8b89-ca37d23118b2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:51.192619 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4ca3d02a-768b-42b5-8b89-ca37d23118b2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:51.537105 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b5f84518-eaf7-41bd-8175-439557b12ffd tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2d7c4e5-1cde-4780-8956-48ae3c1c5223"}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:27:51.540820 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b5f84518-eaf7-41bd-8175-439557b12ffd tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:51.597404 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b5f84518-eaf7-41bd-8175-439557b12ffd tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:51.609304 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b5f84518-eaf7-41bd-8175-439557b12ffd tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:51.611685 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b5f84518-eaf7-41bd-8175-439557b12ffd tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:51.612803 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b5f84518-eaf7-41bd-8175-439557b12ffd tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:51.914335 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-4ca3d02a-768b-42b5-8b89-ca37d23118b2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:51.949339 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-4ca3d02a-768b-42b5-8b89-ca37d23118b2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1322 microversion: 2.1 time: 0.833760 Jul 15 15:27:51.953306 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 107/214] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:51 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1322 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:51.971787 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-6faac908-5f7d-4c27-9b0b-053707fa556f req-aa14f8ff-8fbb-496f-ba82-211bc65842ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5180ff6f-38fa-49c2-9663-9269dcae4849", "tag": "03d3bd84-1aa5-4842-b751-250a289b02fe"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:27:51.998648 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-6faac908-5f7d-4c27-9b0b-053707fa556f req-aa14f8ff-8fbb-496f-ba82-211bc65842ac service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:51.999124 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-6faac908-5f7d-4c27-9b0b-053707fa556f req-aa14f8ff-8fbb-496f-ba82-211bc65842ac service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:52.025673 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-6faac908-5f7d-4c27-9b0b-053707fa556f req-aa14f8ff-8fbb-496f-ba82-211bc65842ac service nova] Creating event network-changed:03d3bd84-1aa5-4842-b751-250a289b02fe for instance 5180ff6f-38fa-49c2-9663-9269dcae4849 on hv-cinder-85001 Jul 15 15:27:52.040386 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-6faac908-5f7d-4c27-9b0b-053707fa556f req-aa14f8ff-8fbb-496f-ba82-211bc65842ac service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085128 Jul 15 15:27:52.041024 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 108/215] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:27:52.056743 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-5348da8f-34cd-49f0-8e0d-4704b527ab11 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:52.060632 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-5348da8f-34cd-49f0-8e0d-4704b527ab11 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:52.082971 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5348da8f-34cd-49f0-8e0d-4704b527ab11 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:52.088271 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5348da8f-34cd-49f0-8e0d-4704b527ab11 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:52.089379 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5348da8f-34cd-49f0-8e0d-4704b527ab11 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:52.092609 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5348da8f-34cd-49f0-8e0d-4704b527ab11 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:52.825818 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b5f84518-eaf7-41bd-8175-439557b12ffd tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "POST /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.303739 Jul 15 15:27:52.833546 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 108/216] 10.222.0.40 () {60 vars in 1322 bytes} [Fri Jul 15 15:27:51 2022] POST /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30/os-volume_attachments => generated 194 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:27:52.989116 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7083f59d-4e45-441b-8ad3-9c56a662440c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:52.992349 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7083f59d-4e45-441b-8ad3-9c56a662440c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:53.031766 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=78 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:53.035274 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7083f59d-4e45-441b-8ad3-9c56a662440c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:53.036311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7083f59d-4e45-441b-8ad3-9c56a662440c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:53.038013 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7083f59d-4e45-441b-8ad3-9c56a662440c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:53.038958 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7083f59d-4e45-441b-8ad3-9c56a662440c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:53.448782 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-5348da8f-34cd-49f0-8e0d-4704b527ab11 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:53.458099 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-5348da8f-34cd-49f0-8e0d-4704b527ab11 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1548 microversion: 2.1 time: 1.412232 Jul 15 15:27:53.463761 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 109/217] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:52 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1548 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:53.506164 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-a7d66dbd-9ebf-494c-94af-9724ed4a619d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:53.507711 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-a7d66dbd-9ebf-494c-94af-9724ed4a619d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:53.521569 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=88 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:27:53.535177 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a7d66dbd-9ebf-494c-94af-9724ed4a619d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:53.536294 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a7d66dbd-9ebf-494c-94af-9724ed4a619d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:53.540260 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a7d66dbd-9ebf-494c-94af-9724ed4a619d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:53.541294 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a7d66dbd-9ebf-494c-94af-9724ed4a619d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:53.586392 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7083f59d-4e45-441b-8ad3-9c56a662440c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:53.619284 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7083f59d-4e45-441b-8ad3-9c56a662440c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1516 microversion: 2.1 time: 0.642272 Jul 15 15:27:53.620839 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 109/218] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:52 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1516 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:53.662831 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a2ba2250-f000-4937-8ac7-b73be80c48a8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:27:53.664969 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a2ba2250-f000-4937-8ac7-b73be80c48a8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:53.687898 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a2ba2250-f000-4937-8ac7-b73be80c48a8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:53.688876 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a2ba2250-f000-4937-8ac7-b73be80c48a8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:53.690321 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a2ba2250-f000-4937-8ac7-b73be80c48a8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:53.692576 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a2ba2250-f000-4937-8ac7-b73be80c48a8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:53.773982 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-a7d66dbd-9ebf-494c-94af-9724ed4a619d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.278653 Jul 15 15:27:53.785738 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 110/219] 10.222.0.40 () {58 vars in 1274 bytes} [Fri Jul 15 15:27:53 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23/os-interface => generated 284 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:27:53.802583 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.objects.instance [None req-a2ba2250-f000-4937-8ac7-b73be80c48a8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lazy-loading 'flavor' on Instance uuid 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 {{(pid=117998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:27:54.095536 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a2ba2250-f000-4937-8ac7-b73be80c48a8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "POST /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0/action" status: 200 len: 32 microversion: 2.1 time: 0.447392 Jul 15 15:27:54.097057 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 110/220] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 15 15:27:53 2022] POST /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0/action => generated 32 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 15 15:27:54.117731 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-6edb0567-9054-47d9-8dd8-8943bb19d12d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:54.119871 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-6edb0567-9054-47d9-8dd8-8943bb19d12d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:54.168401 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6edb0567-9054-47d9-8dd8-8943bb19d12d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:54.169178 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6edb0567-9054-47d9-8dd8-8943bb19d12d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:54.188083 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6edb0567-9054-47d9-8dd8-8943bb19d12d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:54.192456 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6edb0567-9054-47d9-8dd8-8943bb19d12d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:54.990576 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6edb0567-9054-47d9-8dd8-8943bb19d12d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:55.010756 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-6edb0567-9054-47d9-8dd8-8943bb19d12d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.904788 Jul 15 15:27:55.011738 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 111/221] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:54 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:56.045135 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ee554787-0325-43f5-8b3c-a5b11846c4c7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:56.048614 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ee554787-0325-43f5-8b3c-a5b11846c4c7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:56.066218 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ee554787-0325-43f5-8b3c-a5b11846c4c7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:56.067411 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ee554787-0325-43f5-8b3c-a5b11846c4c7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:56.069183 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ee554787-0325-43f5-8b3c-a5b11846c4c7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:56.070168 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ee554787-0325-43f5-8b3c-a5b11846c4c7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:56.987576 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ee554787-0325-43f5-8b3c-a5b11846c4c7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:57.006246 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ee554787-0325-43f5-8b3c-a5b11846c4c7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.969478 Jul 15 15:27:57.008329 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 111/222] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:56 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:57.795690 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-87717d84-cbd3-42e0-b26f-364c8ac0a75d req-67ebb3aa-bb99-458f-8da4-b5c7e6945ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d95c0294-3423-429b-8bcf-43e2089fca23", "tag": "342c12f2-654f-4608-be83-59dbef84ae43"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:27:57.832826 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-87717d84-cbd3-42e0-b26f-364c8ac0a75d req-67ebb3aa-bb99-458f-8da4-b5c7e6945ff8 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:57.832826 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-87717d84-cbd3-42e0-b26f-364c8ac0a75d req-67ebb3aa-bb99-458f-8da4-b5c7e6945ff8 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:57.863973 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-87717d84-cbd3-42e0-b26f-364c8ac0a75d req-67ebb3aa-bb99-458f-8da4-b5c7e6945ff8 service nova] Creating event network-changed:342c12f2-654f-4608-be83-59dbef84ae43 for instance d95c0294-3423-429b-8bcf-43e2089fca23 on hv-cinder-85001 Jul 15 15:27:57.881730 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-87717d84-cbd3-42e0-b26f-364c8ac0a75d req-67ebb3aa-bb99-458f-8da4-b5c7e6945ff8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093989 Jul 15 15:27:57.884123 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 112/223] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:27:58.037388 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-dd398b2a-3e05-4dd0-a612-67372a57b846 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:58.039791 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-dd398b2a-3e05-4dd0-a612-67372a57b846 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:58.073056 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dd398b2a-3e05-4dd0-a612-67372a57b846 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:58.075772 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dd398b2a-3e05-4dd0-a612-67372a57b846 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:58.079255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dd398b2a-3e05-4dd0-a612-67372a57b846 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:58.082105 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dd398b2a-3e05-4dd0-a612-67372a57b846 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:58.492954 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-dd398b2a-3e05-4dd0-a612-67372a57b846 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:58.510599 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-dd398b2a-3e05-4dd0-a612-67372a57b846 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.481674 Jul 15 15:27:58.532896 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 112/224] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:58 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:27:59.544090 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-f3fa7494-c264-4a8d-9770-bdee59738f2a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:27:59.547327 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-f3fa7494-c264-4a8d-9770-bdee59738f2a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:27:59.567449 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f3fa7494-c264-4a8d-9770-bdee59738f2a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:59.576847 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f3fa7494-c264-4a8d-9770-bdee59738f2a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:59.578450 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f3fa7494-c264-4a8d-9770-bdee59738f2a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:27:59.579272 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f3fa7494-c264-4a8d-9770-bdee59738f2a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:27:59.931394 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f3fa7494-c264-4a8d-9770-bdee59738f2a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:27:59.945241 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-f3fa7494-c264-4a8d-9770-bdee59738f2a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.408426 Jul 15 15:27:59.946872 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 113/225] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:27:59 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:00.976619 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-dd2f9bc7-7b41-47d1-936e-1146a3561e56 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:00.977627 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-dd2f9bc7-7b41-47d1-936e-1146a3561e56 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:00.989412 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dd2f9bc7-7b41-47d1-936e-1146a3561e56 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:00.990021 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dd2f9bc7-7b41-47d1-936e-1146a3561e56 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:00.991047 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dd2f9bc7-7b41-47d1-936e-1146a3561e56 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:00.991708 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dd2f9bc7-7b41-47d1-936e-1146a3561e56 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:01.000248 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:28:01.243147 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-dd2f9bc7-7b41-47d1-936e-1146a3561e56 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:01.256444 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-dd2f9bc7-7b41-47d1-936e-1146a3561e56 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.286707 Jul 15 15:28:01.257683 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 113/226] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:00 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:02.284245 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-5b05e43b-aee3-481a-9c62-8e4819347881 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:02.284977 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-5b05e43b-aee3-481a-9c62-8e4819347881 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:02.292629 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5b05e43b-aee3-481a-9c62-8e4819347881 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:02.293498 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5b05e43b-aee3-481a-9c62-8e4819347881 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:02.295222 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5b05e43b-aee3-481a-9c62-8e4819347881 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:02.295901 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5b05e43b-aee3-481a-9c62-8e4819347881 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:02.520411 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-5b05e43b-aee3-481a-9c62-8e4819347881 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:02.534772 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-5b05e43b-aee3-481a-9c62-8e4819347881 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.254957 Jul 15 15:28:02.535634 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 114/227] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:02 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:03.557013 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-90296b2a-61d9-47bf-bb2a-1c3880287b96 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:03.558244 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-90296b2a-61d9-47bf-bb2a-1c3880287b96 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:03.566570 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-90296b2a-61d9-47bf-bb2a-1c3880287b96 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:03.567246 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-90296b2a-61d9-47bf-bb2a-1c3880287b96 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:03.568613 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-90296b2a-61d9-47bf-bb2a-1c3880287b96 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:03.569396 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-90296b2a-61d9-47bf-bb2a-1c3880287b96 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:03.778868 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-90296b2a-61d9-47bf-bb2a-1c3880287b96 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:03.792868 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-90296b2a-61d9-47bf-bb2a-1c3880287b96 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.241569 Jul 15 15:28:03.794022 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 114/228] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:03 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:04.820711 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-a022d24c-4d6d-4253-831f-774706df13f7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:04.821671 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-a022d24c-4d6d-4253-831f-774706df13f7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:04.829818 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a022d24c-4d6d-4253-831f-774706df13f7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:04.830233 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a022d24c-4d6d-4253-831f-774706df13f7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:04.831058 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a022d24c-4d6d-4253-831f-774706df13f7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:04.831495 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a022d24c-4d6d-4253-831f-774706df13f7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:05.032452 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-a022d24c-4d6d-4253-831f-774706df13f7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:05.036844 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=100 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:28:05.044475 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-a022d24c-4d6d-4253-831f-774706df13f7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.233157 Jul 15 15:28:05.045072 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 115/229] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:04 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:06.067166 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b28357f4-6c5c-4e5f-a880-5691f36499f5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:06.068208 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b28357f4-6c5c-4e5f-a880-5691f36499f5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:06.077621 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b28357f4-6c5c-4e5f-a880-5691f36499f5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:06.078143 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b28357f4-6c5c-4e5f-a880-5691f36499f5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:06.079470 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b28357f4-6c5c-4e5f-a880-5691f36499f5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:06.080160 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b28357f4-6c5c-4e5f-a880-5691f36499f5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:06.322110 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b28357f4-6c5c-4e5f-a880-5691f36499f5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:06.335084 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b28357f4-6c5c-4e5f-a880-5691f36499f5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.273568 Jul 15 15:28:06.348482 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 115/230] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:06 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:07.364504 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-9ebaf98d-5bf8-4ee6-88b3-8c3c1baa45e8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:07.373464 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-9ebaf98d-5bf8-4ee6-88b3-8c3c1baa45e8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:07.392066 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9ebaf98d-5bf8-4ee6-88b3-8c3c1baa45e8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:07.392825 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9ebaf98d-5bf8-4ee6-88b3-8c3c1baa45e8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:07.395920 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9ebaf98d-5bf8-4ee6-88b3-8c3c1baa45e8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:07.396841 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9ebaf98d-5bf8-4ee6-88b3-8c3c1baa45e8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:07.765727 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-9ebaf98d-5bf8-4ee6-88b3-8c3c1baa45e8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:07.792518 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-9ebaf98d-5bf8-4ee6-88b3-8c3c1baa45e8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.438281 Jul 15 15:28:07.796524 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 116/231] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:07 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:08.181858 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6ecb8437-2ae3-479f-a735-6a11de4d3547 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:08.182908 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6ecb8437-2ae3-479f-a735-6a11de4d3547 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:08.194395 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6ecb8437-2ae3-479f-a735-6a11de4d3547 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:08.196037 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6ecb8437-2ae3-479f-a735-6a11de4d3547 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:08.197509 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6ecb8437-2ae3-479f-a735-6a11de4d3547 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:08.197953 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6ecb8437-2ae3-479f-a735-6a11de4d3547 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:08.230512 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6ecb8437-2ae3-479f-a735-6a11de4d3547 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Going to try to terminate instance {{(pid=117998) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 15:28:08.354390 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6ecb8437-2ae3-479f-a735-6a11de4d3547 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "DELETE /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 204 len: 0 microversion: 2.1 time: 0.187630 Jul 15 15:28:08.355405 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 116/232] 10.222.0.40 () {58 vars in 1238 bytes} [Fri Jul 15 15:28:08 2022] DELETE /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:28:08.364013 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-513fffa4-5f40-41fa-acfb-ec8fb7890039 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:08.364638 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-513fffa4-5f40-41fa-acfb-ec8fb7890039 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:08.373004 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-513fffa4-5f40-41fa-acfb-ec8fb7890039 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:08.373773 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-513fffa4-5f40-41fa-acfb-ec8fb7890039 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:08.374739 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-513fffa4-5f40-41fa-acfb-ec8fb7890039 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:08.375165 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-513fffa4-5f40-41fa-acfb-ec8fb7890039 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:08.581409 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-513fffa4-5f40-41fa-acfb-ec8fb7890039 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:08.597331 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-513fffa4-5f40-41fa-acfb-ec8fb7890039 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1554 microversion: 2.1 time: 0.236830 Jul 15 15:28:08.598398 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 117/233] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:08 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1554 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:08.826064 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-83cbabdb-508a-41dd-aa25-cff944eda966 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:08.826975 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-83cbabdb-508a-41dd-aa25-cff944eda966 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:08.838488 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-83cbabdb-508a-41dd-aa25-cff944eda966 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:08.839130 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-83cbabdb-508a-41dd-aa25-cff944eda966 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:08.842057 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-83cbabdb-508a-41dd-aa25-cff944eda966 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:08.842693 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-83cbabdb-508a-41dd-aa25-cff944eda966 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:09.117089 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-83cbabdb-508a-41dd-aa25-cff944eda966 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:09.128076 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-83cbabdb-508a-41dd-aa25-cff944eda966 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.308454 Jul 15 15:28:09.132142 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 117/234] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:08 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:09.626738 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-72aacae2-56f4-48d8-b74d-64ba29b030b8 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:09.628810 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-72aacae2-56f4-48d8-b74d-64ba29b030b8 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:09.641657 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-72aacae2-56f4-48d8-b74d-64ba29b030b8 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:09.642466 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-72aacae2-56f4-48d8-b74d-64ba29b030b8 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:09.644107 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-72aacae2-56f4-48d8-b74d-64ba29b030b8 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:09.644828 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-72aacae2-56f4-48d8-b74d-64ba29b030b8 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:09.896394 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-72aacae2-56f4-48d8-b74d-64ba29b030b8 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:09.915183 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-72aacae2-56f4-48d8-b74d-64ba29b030b8 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1554 microversion: 2.1 time: 0.295207 Jul 15 15:28:09.916118 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 118/235] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:09 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1554 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:10.154691 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8dadd587-4ae2-4a8b-88a6-f571e90102aa tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:10.156886 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8dadd587-4ae2-4a8b-88a6-f571e90102aa tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:10.173455 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8dadd587-4ae2-4a8b-88a6-f571e90102aa tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:10.173455 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8dadd587-4ae2-4a8b-88a6-f571e90102aa tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:10.173455 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8dadd587-4ae2-4a8b-88a6-f571e90102aa tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:10.173455 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8dadd587-4ae2-4a8b-88a6-f571e90102aa tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:10.441537 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8dadd587-4ae2-4a8b-88a6-f571e90102aa tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:10.456507 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8dadd587-4ae2-4a8b-88a6-f571e90102aa tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.309912 Jul 15 15:28:10.457526 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 118/236] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:10 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:10.960385 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-88fc0cd9-bc0f-43cd-a64b-e02614cb6f38 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:10.962547 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-88fc0cd9-bc0f-43cd-a64b-e02614cb6f38 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:10.976004 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-88fc0cd9-bc0f-43cd-a64b-e02614cb6f38 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:10.977993 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-88fc0cd9-bc0f-43cd-a64b-e02614cb6f38 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:10.980599 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-88fc0cd9-bc0f-43cd-a64b-e02614cb6f38 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:10.982574 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-88fc0cd9-bc0f-43cd-a64b-e02614cb6f38 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:11.312642 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-88fc0cd9-bc0f-43cd-a64b-e02614cb6f38 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:11.331277 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-88fc0cd9-bc0f-43cd-a64b-e02614cb6f38 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1554 microversion: 2.1 time: 0.384892 Jul 15 15:28:11.332860 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 119/237] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:10 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1554 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:11.487787 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-602dd609-64ac-4686-aec2-3b4052cfda9c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:11.489733 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-602dd609-64ac-4686-aec2-3b4052cfda9c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:11.497996 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-602dd609-64ac-4686-aec2-3b4052cfda9c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:11.498369 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-602dd609-64ac-4686-aec2-3b4052cfda9c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:11.499214 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-602dd609-64ac-4686-aec2-3b4052cfda9c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:11.499607 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-602dd609-64ac-4686-aec2-3b4052cfda9c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:11.710874 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-602dd609-64ac-4686-aec2-3b4052cfda9c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:11.724671 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-602dd609-64ac-4686-aec2-3b4052cfda9c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.242747 Jul 15 15:28:11.727274 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 119/238] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:11 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:12.351749 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-8a85ead4-0946-4549-adb9-4950317a7f8b tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:12.353040 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-8a85ead4-0946-4549-adb9-4950317a7f8b tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:12.366227 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8a85ead4-0946-4549-adb9-4950317a7f8b tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:12.366702 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8a85ead4-0946-4549-adb9-4950317a7f8b tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:12.367488 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8a85ead4-0946-4549-adb9-4950317a7f8b tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:12.367911 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8a85ead4-0946-4549-adb9-4950317a7f8b tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:12.669439 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-8a85ead4-0946-4549-adb9-4950317a7f8b tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:12.710805 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-8a85ead4-0946-4549-adb9-4950317a7f8b tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1554 microversion: 2.1 time: 0.362630 Jul 15 15:28:12.729401 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 120/239] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:12 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1554 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:12.755796 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8d25d495-7da4-44a0-93ff-a7eaacff87d1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:12.756583 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8d25d495-7da4-44a0-93ff-a7eaacff87d1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:12.770625 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8d25d495-7da4-44a0-93ff-a7eaacff87d1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:12.776039 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8d25d495-7da4-44a0-93ff-a7eaacff87d1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:12.777273 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8d25d495-7da4-44a0-93ff-a7eaacff87d1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:12.778618 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8d25d495-7da4-44a0-93ff-a7eaacff87d1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:13.062147 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-7330a90d-0b1b-41de-89b7-484b0c190864 req-6f28418e-e395-46e8-8959-1ee90f786cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59fc0e3c-5238-40d8-a589-60ceb542cf30", "name": "network-vif-deleted", "tag": "41019c37-3597-4667-9423-efc3b2c8ab76"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:28:13.075063 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-7330a90d-0b1b-41de-89b7-484b0c190864 req-6f28418e-e395-46e8-8959-1ee90f786cb6 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:13.080889 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-7330a90d-0b1b-41de-89b7-484b0c190864 req-6f28418e-e395-46e8-8959-1ee90f786cb6 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:13.128870 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-7330a90d-0b1b-41de-89b7-484b0c190864 req-6f28418e-e395-46e8-8959-1ee90f786cb6 service nova] Creating event network-vif-deleted:41019c37-3597-4667-9423-efc3b2c8ab76 for instance 59fc0e3c-5238-40d8-a589-60ceb542cf30 on hv-cinder-85001 Jul 15 15:28:13.135851 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8d25d495-7da4-44a0-93ff-a7eaacff87d1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:13.165705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-7330a90d-0b1b-41de-89b7-484b0c190864 req-6f28418e-e395-46e8-8959-1ee90f786cb6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106954 Jul 15 15:28:13.166134 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8d25d495-7da4-44a0-93ff-a7eaacff87d1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.416242 Jul 15 15:28:13.168395 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 121/240] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:28:13.173819 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 120/241] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:12 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:13.747692 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-67f63727-4715-4a37-8a18-d56abb2664a0 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:13.750168 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-67f63727-4715-4a37-8a18-d56abb2664a0 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:13.766682 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-67f63727-4715-4a37-8a18-d56abb2664a0 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:13.768150 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-67f63727-4715-4a37-8a18-d56abb2664a0 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:13.770003 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-67f63727-4715-4a37-8a18-d56abb2664a0 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:13.770742 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-67f63727-4715-4a37-8a18-d56abb2664a0 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:13.831616 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-67f63727-4715-4a37-8a18-d56abb2664a0 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:13.831616 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-67f63727-4715-4a37-8a18-d56abb2664a0 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:13.831616 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.objects.instance [None req-67f63727-4715-4a37-8a18-d56abb2664a0 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lazy-loading 'fault' on Instance uuid 59fc0e3c-5238-40d8-a589-60ceb542cf30 {{(pid=117999) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:28:13.926918 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-67f63727-4715-4a37-8a18-d56abb2664a0 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a01407bfc0a480a8f6702993ddb0183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1097bdacbb44067bfa5dbf28bc86d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:13.954179 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-67f63727-4715-4a37-8a18-d56abb2664a0 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 200 len: 1351 microversion: 2.1 time: 0.211633 Jul 15 15:28:13.966572 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 122/242] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:13 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 1351 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:14.191801 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-629ce3c8-a710-4d93-91a0-e31447d45647 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:14.193048 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-629ce3c8-a710-4d93-91a0-e31447d45647 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:14.205398 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-629ce3c8-a710-4d93-91a0-e31447d45647 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:14.206430 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-629ce3c8-a710-4d93-91a0-e31447d45647 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:14.207872 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-629ce3c8-a710-4d93-91a0-e31447d45647 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:14.208569 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-629ce3c8-a710-4d93-91a0-e31447d45647 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:14.429608 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-629ce3c8-a710-4d93-91a0-e31447d45647 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:14.443307 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-629ce3c8-a710-4d93-91a0-e31447d45647 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.256157 Jul 15 15:28:14.444687 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 121/243] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:14 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:14.985032 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-2a919704-a665-496d-a3c2-0d16d93e8d78 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:14.985820 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-2a919704-a665-496d-a3c2-0d16d93e8d78 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:14.994679 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2a919704-a665-496d-a3c2-0d16d93e8d78 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:14.995321 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2a919704-a665-496d-a3c2-0d16d93e8d78 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:14.997046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2a919704-a665-496d-a3c2-0d16d93e8d78 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:14.997601 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2a919704-a665-496d-a3c2-0d16d93e8d78 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:15.018361 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.wsgi [None req-2a919704-a665-496d-a3c2-0d16d93e8d78 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] HTTP exception thrown: Instance 59fc0e3c-5238-40d8-a589-60ceb542cf30 could not be found. Jul 15 15:28:15.025003 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-2a919704-a665-496d-a3c2-0d16d93e8d78 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Request method failure captured: Jul 15 15:28:15.025003 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: request: GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 HTTP/1.1 Jul 15 15:28:15.025003 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept: application/json Jul 15 15:28:15.025003 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept-Encoding: identity Jul 15 15:28:15.025003 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Connection: close Jul 15 15:28:15.025003 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Length: 0 Jul 15 15:28:15.025003 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Type: application/json Jul 15 15:28:15.025003 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Host: 10.222.0.40 Jul 15 15:28:15.025003 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Openstack-System-Scope: None Jul 15 15:28:15.025003 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: User-Agent: python-urllib3/1.26.9 Jul 15 15:28:15.025003 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Auth-Token: gAAAAABi0YctxPPgh2TFjFqb45Npe_zpj3vRDg1sS1LdWg3TN30GA7ZErGl1-5wG1dD02W8nN0UKbqrk4i-OUCSOi4EisioYWB6YkIapgabtb1gGJ3W0oTGfs9coLt1gp2TDgV1MVqTldNp9JVPZ1bLAlSYwnu15HesFrLDJhUxYiJ2bq3rx1ro Jul 15 15:28:15.025003 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Id: None Jul 15 15:28:15.025003 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Name: None Jul 15 15:28:15.025003 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Identity-Status: Confirmed Jul 15 15:28:15.025003 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Is-Admin-Project: True Jul 15 15:28:15.025003 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Id: default Jul 15 15:28:15.025003 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Name: Default Jul 15 15:28:15.025003 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Id: f1097bdacbb44067bfa5dbf28bc86d9a Jul 15 15:28:15.025003 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Name: tempest-DeleteServersTestJSON-1449665006 Jul 15 15:28:15.025003 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Role: member,reader Jul 15 15:28:15.025003 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Roles: member,reader Jul 15 15:28:15.027554 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f1097bdacbb44067bfa5dbf28bc86d9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f1097bdacbb44067bfa5dbf28bc86d9a", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1097bdacbb44067bfa5dbf28bc86d9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1097bdacbb44067bfa5dbf28bc86d9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:28:15.027554 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant: tempest-DeleteServersTestJSON-1449665006 Jul 15 15:28:15.027554 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Id: f1097bdacbb44067bfa5dbf28bc86d9a Jul 15 15:28:15.027554 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Name: tempest-DeleteServersTestJSON-1449665006 Jul 15 15:28:15.027554 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User: tempest-DeleteServersTestJSON-1449665006-project Jul 15 15:28:15.027554 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Id: default Jul 15 15:28:15.027554 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Name: Default Jul 15 15:28:15.027554 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Id: 2a01407bfc0a480a8f6702993ddb0183 Jul 15 15:28:15.027554 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Name: tempest-DeleteServersTestJSON-1449665006-project Jul 15 15:28:15.027554 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: method: > Jul 15 15:28:15.027554 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: exception: Instance 59fc0e3c-5238-40d8-a589-60ceb542cf30 could not be found. Jul 15 15:28:15.027554 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: action_args: {'id': '59fc0e3c-5238-40d8-a589-60ceb542cf30'} Jul 15 15:28:15.028794 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:28:15.028794 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:28:15.028794 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:28:15.028794 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:28:15.028794 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:28:15.028794 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:28:15.028794 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:28:15.028794 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:28:15.028794 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:28:15.028794 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:28:15.028794 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59fc0e3c-5238-40d8-a589-60ceb542cf30 could not be found. Jul 15 15:28:15.028794 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:28:15.028794 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:28:15.028794 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:28:15.028794 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:28:15.028794 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:28:15.028794 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:28:15.028794 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:28:15.028794 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:28:15.028794 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:28:15.030924 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:28:15.030924 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:28:15.030924 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:28:15.030924 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:28:15.030924 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:28:15.030924 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:28:15.030924 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:28:15.030924 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59fc0e3c-5238-40d8-a589-60ceb542cf30 could not be found. Jul 15 15:28:15.030924 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:28:15.030924 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:28:15.030924 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:28:15.030924 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:28:15.030924 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:28:15.030924 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:28:15.030924 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:28:15.030924 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:28:15.030924 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59fc0e3c-5238-40d8-a589-60ceb542cf30 could not be found. Jul 15 15:28:15.030924 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:28:15.032592 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-2a919704-a665-496d-a3c2-0d16d93e8d78 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Returning 404 to user: Instance 59fc0e3c-5238-40d8-a589-60ceb542cf30 could not be found. {{(pid=117999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:28:15.032592 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-2a919704-a665-496d-a3c2-0d16d93e8d78 tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 404 len: 111 microversion: 2.1 time: 0.046800 Jul 15 15:28:15.032592 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 123/244] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:14 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:28:15.187273 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9254306c-3ecd-422d-8076-93e302511b6a tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:15.189200 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9254306c-3ecd-422d-8076-93e302511b6a tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:15.202748 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9254306c-3ecd-422d-8076-93e302511b6a tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:15.203736 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9254306c-3ecd-422d-8076-93e302511b6a tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:15.206761 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9254306c-3ecd-422d-8076-93e302511b6a tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:15.208922 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9254306c-3ecd-422d-8076-93e302511b6a tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:15.231380 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-9254306c-3ecd-422d-8076-93e302511b6a tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] HTTP exception thrown: Instance 59fc0e3c-5238-40d8-a589-60ceb542cf30 could not be found. Jul 15 15:28:15.238447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9254306c-3ecd-422d-8076-93e302511b6a tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Request method failure captured: Jul 15 15:28:15.238447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30/os-volume_attachments HTTP/1.1 Jul 15 15:28:15.238447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:28:15.238447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:28:15.238447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:28:15.238447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 15 15:28:15.238447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:28:15.238447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:28:15.238447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:28:15.238447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:28:15.238447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0YctxPPgh2TFjFqb45Npe_zpj3vRDg1sS1LdWg3TN30GA7ZErGl1-5wG1dD02W8nN0UKbqrk4i-OUCSOi4EisioYWB6YkIapgabtb1gGJ3W0oTGfs9coLt1gp2TDgV1MVqTldNp9JVPZ1bLAlSYwnu15HesFrLDJhUxYiJ2bq3rx1ro Jul 15 15:28:15.238447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:28:15.238447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:28:15.238447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:28:15.238447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:28:15.238447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:28:15.238447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:28:15.238447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: f1097bdacbb44067bfa5dbf28bc86d9a Jul 15 15:28:15.238447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-DeleteServersTestJSON-1449665006 Jul 15 15:28:15.238447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:28:15.238447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:28:15.240277 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f1097bdacbb44067bfa5dbf28bc86d9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f1097bdacbb44067bfa5dbf28bc86d9a", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1097bdacbb44067bfa5dbf28bc86d9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1097bdacbb44067bfa5dbf28bc86d9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:28:15.240277 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-DeleteServersTestJSON-1449665006 Jul 15 15:28:15.240277 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: f1097bdacbb44067bfa5dbf28bc86d9a Jul 15 15:28:15.240277 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-DeleteServersTestJSON-1449665006 Jul 15 15:28:15.240277 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-DeleteServersTestJSON-1449665006-project Jul 15 15:28:15.240277 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:28:15.240277 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:28:15.240277 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: 2a01407bfc0a480a8f6702993ddb0183 Jul 15 15:28:15.240277 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-DeleteServersTestJSON-1449665006-project Jul 15 15:28:15.240277 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: > Jul 15 15:28:15.240277 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Instance 59fc0e3c-5238-40d8-a589-60ceb542cf30 could not be found. Jul 15 15:28:15.240277 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'server_id': '59fc0e3c-5238-40d8-a589-60ceb542cf30'} Jul 15 15:28:15.240934 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:28:15.240934 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:28:15.240934 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:28:15.240934 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:28:15.240934 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:28:15.240934 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:28:15.240934 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:28:15.240934 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:28:15.240934 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:28:15.240934 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:28:15.240934 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59fc0e3c-5238-40d8-a589-60ceb542cf30 could not be found. Jul 15 15:28:15.240934 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:28:15.240934 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:28:15.240934 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:28:15.240934 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:28:15.240934 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:28:15.240934 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:28:15.240934 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:28:15.240934 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:28:15.240934 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:28:15.242194 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:28:15.242194 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 15 15:28:15.242194 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 15:28:15.242194 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 15 15:28:15.242194 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 15:28:15.242194 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 15 15:28:15.242194 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 15 15:28:15.242194 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:28:15.242194 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:28:15.242194 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59fc0e3c-5238-40d8-a589-60ceb542cf30 could not be found. Jul 15 15:28:15.242194 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:28:15.242194 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:28:15.242194 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:28:15.242194 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:28:15.242194 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:28:15.242194 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:28:15.242194 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:28:15.242194 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:28:15.242194 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59fc0e3c-5238-40d8-a589-60ceb542cf30 could not be found. Jul 15 15:28:15.242194 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:28:15.243404 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9254306c-3ecd-422d-8076-93e302511b6a tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Returning 404 to user: Instance 59fc0e3c-5238-40d8-a589-60ceb542cf30 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:28:15.243404 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9254306c-3ecd-422d-8076-93e302511b6a tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.061867 Jul 15 15:28:15.243404 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 122/245] 10.222.0.40 () {58 vars in 1301 bytes} [Fri Jul 15 15:28:15 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30/os-volume_attachments => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:28:15.466319 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-31bf07c5-5b85-4955-af0a-6970f2bbef2d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:15.474766 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-31bf07c5-5b85-4955-af0a-6970f2bbef2d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:15.478241 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-31bf07c5-5b85-4955-af0a-6970f2bbef2d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:15.479314 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-31bf07c5-5b85-4955-af0a-6970f2bbef2d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:15.480921 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-31bf07c5-5b85-4955-af0a-6970f2bbef2d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:15.481609 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-31bf07c5-5b85-4955-af0a-6970f2bbef2d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:15.943765 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-31bf07c5-5b85-4955-af0a-6970f2bbef2d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:15.960809 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-31bf07c5-5b85-4955-af0a-6970f2bbef2d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.501798 Jul 15 15:28:15.962235 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 124/246] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:15 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:16.990818 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-67d9caf5-1357-43ed-b165-7a70ecc9cc67 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:16.991736 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-67d9caf5-1357-43ed-b165-7a70ecc9cc67 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:17.002152 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-67d9caf5-1357-43ed-b165-7a70ecc9cc67 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:17.002980 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-67d9caf5-1357-43ed-b165-7a70ecc9cc67 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:17.004223 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-67d9caf5-1357-43ed-b165-7a70ecc9cc67 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:17.004952 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-67d9caf5-1357-43ed-b165-7a70ecc9cc67 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:17.186956 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-67d9caf5-1357-43ed-b165-7a70ecc9cc67 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:17.195261 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-67d9caf5-1357-43ed-b165-7a70ecc9cc67 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.209397 Jul 15 15:28:17.195766 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 123/247] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:16 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:28:18.213270 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-2ec10411-a994-4cf4-8927-e766a63f4259 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:18.214122 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-2ec10411-a994-4cf4-8927-e766a63f4259 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:18.222951 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2ec10411-a994-4cf4-8927-e766a63f4259 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:18.223473 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2ec10411-a994-4cf4-8927-e766a63f4259 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:18.224248 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2ec10411-a994-4cf4-8927-e766a63f4259 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:18.224782 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2ec10411-a994-4cf4-8927-e766a63f4259 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:18.405447 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-2ec10411-a994-4cf4-8927-e766a63f4259 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:18.419172 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-2ec10411-a994-4cf4-8927-e766a63f4259 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.209948 Jul 15 15:28:18.420212 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 125/248] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:18 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:19.449056 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4c32c9bb-3fc1-4b43-b976-cf1c2af1bde6 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:19.450409 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-4c32c9bb-3fc1-4b43-b976-cf1c2af1bde6 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:19.464588 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4c32c9bb-3fc1-4b43-b976-cf1c2af1bde6 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:19.465451 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4c32c9bb-3fc1-4b43-b976-cf1c2af1bde6 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:19.467113 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4c32c9bb-3fc1-4b43-b976-cf1c2af1bde6 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:19.467801 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4c32c9bb-3fc1-4b43-b976-cf1c2af1bde6 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:19.645182 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-4c32c9bb-3fc1-4b43-b976-cf1c2af1bde6 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:19.654257 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4c32c9bb-3fc1-4b43-b976-cf1c2af1bde6 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.212753 Jul 15 15:28:19.654892 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 124/249] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:19 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:20.676632 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-74af405d-d95d-4513-9a78-7ff7233b6d47 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:20.677486 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-74af405d-d95d-4513-9a78-7ff7233b6d47 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:20.688147 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-74af405d-d95d-4513-9a78-7ff7233b6d47 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:20.688929 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-74af405d-d95d-4513-9a78-7ff7233b6d47 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:20.690641 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-74af405d-d95d-4513-9a78-7ff7233b6d47 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:20.691397 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-74af405d-d95d-4513-9a78-7ff7233b6d47 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:20.919424 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-74af405d-d95d-4513-9a78-7ff7233b6d47 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:20.927708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-74af405d-d95d-4513-9a78-7ff7233b6d47 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.257818 Jul 15 15:28:20.928290 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 126/250] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:20 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:21.968329 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5fa76745-4bf1-44ab-9bbd-06194e690d06 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:21.971556 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5fa76745-4bf1-44ab-9bbd-06194e690d06 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:21.982654 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5fa76745-4bf1-44ab-9bbd-06194e690d06 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:21.983708 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5fa76745-4bf1-44ab-9bbd-06194e690d06 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:21.985310 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5fa76745-4bf1-44ab-9bbd-06194e690d06 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:21.986510 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5fa76745-4bf1-44ab-9bbd-06194e690d06 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:22.260547 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5fa76745-4bf1-44ab-9bbd-06194e690d06 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:22.277822 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5fa76745-4bf1-44ab-9bbd-06194e690d06 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.329208 Jul 15 15:28:22.278352 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 125/251] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:21 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:23.295762 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-0d06808e-e501-4e10-b326-482d82485cc5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:23.296643 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-0d06808e-e501-4e10-b326-482d82485cc5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:23.303487 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0d06808e-e501-4e10-b326-482d82485cc5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:23.303926 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0d06808e-e501-4e10-b326-482d82485cc5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:23.304706 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0d06808e-e501-4e10-b326-482d82485cc5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:23.305128 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0d06808e-e501-4e10-b326-482d82485cc5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:23.524947 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-0d06808e-e501-4e10-b326-482d82485cc5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:23.537355 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-0d06808e-e501-4e10-b326-482d82485cc5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.245383 Jul 15 15:28:23.538264 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 127/252] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:23 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:24.562193 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9b7688a0-120a-4c73-ad0f-78fb55edaccb tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:24.562924 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9b7688a0-120a-4c73-ad0f-78fb55edaccb tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:24.565286 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:28:24.575747 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9b7688a0-120a-4c73-ad0f-78fb55edaccb tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:24.576480 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9b7688a0-120a-4c73-ad0f-78fb55edaccb tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:24.578011 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9b7688a0-120a-4c73-ad0f-78fb55edaccb tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:24.578726 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9b7688a0-120a-4c73-ad0f-78fb55edaccb tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:24.752185 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9b7688a0-120a-4c73-ad0f-78fb55edaccb tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:24.763068 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9b7688a0-120a-4c73-ad0f-78fb55edaccb tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.205905 Jul 15 15:28:24.763772 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 126/253] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:24 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:25.793033 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-b080dfb1-ca2b-45c2-a37d-b9f955e4bb43 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:25.794151 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-b080dfb1-ca2b-45c2-a37d-b9f955e4bb43 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:25.797182 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=38 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:28:25.802837 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b080dfb1-ca2b-45c2-a37d-b9f955e4bb43 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:25.803695 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b080dfb1-ca2b-45c2-a37d-b9f955e4bb43 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:25.804981 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b080dfb1-ca2b-45c2-a37d-b9f955e4bb43 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:25.805446 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b080dfb1-ca2b-45c2-a37d-b9f955e4bb43 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:26.024408 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b080dfb1-ca2b-45c2-a37d-b9f955e4bb43 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:26.034082 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-b080dfb1-ca2b-45c2-a37d-b9f955e4bb43 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.246159 Jul 15 15:28:26.034699 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 128/254] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:25 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:27.056350 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b70704e0-90d8-4e76-a1cb-dd3afe180895 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:27.057454 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b70704e0-90d8-4e76-a1cb-dd3afe180895 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:27.069042 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b70704e0-90d8-4e76-a1cb-dd3afe180895 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:27.069739 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b70704e0-90d8-4e76-a1cb-dd3afe180895 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:27.070958 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b70704e0-90d8-4e76-a1cb-dd3afe180895 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:27.071658 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b70704e0-90d8-4e76-a1cb-dd3afe180895 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:27.236045 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b70704e0-90d8-4e76-a1cb-dd3afe180895 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:27.249305 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b70704e0-90d8-4e76-a1cb-dd3afe180895 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.200240 Jul 15 15:28:27.250298 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 127/255] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:27 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:27.351876 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-c75f3670-c2ca-4afc-b128-2d453489b47e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:27.352768 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-c75f3670-c2ca-4afc-b128-2d453489b47e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:27.367128 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c75f3670-c2ca-4afc-b128-2d453489b47e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:27.367628 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c75f3670-c2ca-4afc-b128-2d453489b47e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:27.369242 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c75f3670-c2ca-4afc-b128-2d453489b47e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:27.370210 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c75f3670-c2ca-4afc-b128-2d453489b47e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:27.391905 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.wsgi [None req-c75f3670-c2ca-4afc-b128-2d453489b47e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] HTTP exception thrown: Instance 59fc0e3c-5238-40d8-a589-60ceb542cf30 could not be found. Jul 15 15:28:27.393459 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-c75f3670-c2ca-4afc-b128-2d453489b47e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Request method failure captured: Jul 15 15:28:27.393459 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: request: DELETE /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 HTTP/1.1 Jul 15 15:28:27.393459 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept: application/json Jul 15 15:28:27.393459 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept-Encoding: identity Jul 15 15:28:27.393459 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Connection: close Jul 15 15:28:27.393459 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Length: 0 Jul 15 15:28:27.393459 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Type: application/json Jul 15 15:28:27.393459 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Host: 10.222.0.40 Jul 15 15:28:27.393459 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Openstack-System-Scope: None Jul 15 15:28:27.393459 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: User-Agent: python-urllib3/1.26.9 Jul 15 15:28:27.393459 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Auth-Token: gAAAAABi0YctxPPgh2TFjFqb45Npe_zpj3vRDg1sS1LdWg3TN30GA7ZErGl1-5wG1dD02W8nN0UKbqrk4i-OUCSOi4EisioYWB6YkIapgabtb1gGJ3W0oTGfs9coLt1gp2TDgV1MVqTldNp9JVPZ1bLAlSYwnu15HesFrLDJhUxYiJ2bq3rx1ro Jul 15 15:28:27.393459 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Id: None Jul 15 15:28:27.393459 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Name: None Jul 15 15:28:27.393459 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Identity-Status: Confirmed Jul 15 15:28:27.393459 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Is-Admin-Project: True Jul 15 15:28:27.393459 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Id: default Jul 15 15:28:27.393459 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Name: Default Jul 15 15:28:27.393459 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Id: f1097bdacbb44067bfa5dbf28bc86d9a Jul 15 15:28:27.393459 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Name: tempest-DeleteServersTestJSON-1449665006 Jul 15 15:28:27.393459 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Role: member,reader Jul 15 15:28:27.393459 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Roles: member,reader Jul 15 15:28:27.401541 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f1097bdacbb44067bfa5dbf28bc86d9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f1097bdacbb44067bfa5dbf28bc86d9a", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1097bdacbb44067bfa5dbf28bc86d9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1097bdacbb44067bfa5dbf28bc86d9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:28:27.401541 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant: tempest-DeleteServersTestJSON-1449665006 Jul 15 15:28:27.401541 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Id: f1097bdacbb44067bfa5dbf28bc86d9a Jul 15 15:28:27.401541 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Name: tempest-DeleteServersTestJSON-1449665006 Jul 15 15:28:27.401541 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User: tempest-DeleteServersTestJSON-1449665006-project Jul 15 15:28:27.401541 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Id: default Jul 15 15:28:27.401541 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Name: Default Jul 15 15:28:27.401541 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Id: 2a01407bfc0a480a8f6702993ddb0183 Jul 15 15:28:27.401541 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Name: tempest-DeleteServersTestJSON-1449665006-project Jul 15 15:28:27.401541 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: method: > Jul 15 15:28:27.401541 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: exception: Instance 59fc0e3c-5238-40d8-a589-60ceb542cf30 could not be found. Jul 15 15:28:27.401541 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: action_args: {'id': '59fc0e3c-5238-40d8-a589-60ceb542cf30'} Jul 15 15:28:27.404489 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:28:27.404489 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:28:27.404489 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:28:27.404489 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:28:27.404489 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:28:27.404489 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:28:27.404489 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:28:27.404489 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:28:27.404489 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:28:27.404489 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:28:27.404489 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59fc0e3c-5238-40d8-a589-60ceb542cf30 could not be found. Jul 15 15:28:27.404489 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:28:27.404489 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:28:27.404489 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:28:27.404489 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:28:27.404489 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:28:27.404489 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:28:27.404489 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:28:27.404489 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:28:27.404489 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:28:27.405819 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:28:27.405819 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 15:28:27.405819 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 15:28:27.405819 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 15:28:27.405819 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 15:28:27.405819 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:28:27.405819 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:28:27.405819 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:28:27.405819 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:28:27.405819 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59fc0e3c-5238-40d8-a589-60ceb542cf30 could not be found. Jul 15 15:28:27.405819 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:28:27.405819 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:28:27.405819 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:28:27.405819 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:28:27.405819 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:28:27.405819 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:28:27.405819 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:28:27.405819 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:28:27.405819 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59fc0e3c-5238-40d8-a589-60ceb542cf30 could not be found. Jul 15 15:28:27.405819 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:28:27.408900 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-c75f3670-c2ca-4afc-b128-2d453489b47e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Returning 404 to user: Instance 59fc0e3c-5238-40d8-a589-60ceb542cf30 could not be found. {{(pid=117999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:28:27.408900 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-c75f3670-c2ca-4afc-b128-2d453489b47e tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "DELETE /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 404 len: 111 microversion: 2.1 time: 0.048129 Jul 15 15:28:27.408900 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 129/256] 10.222.0.40 () {58 vars in 1238 bytes} [Fri Jul 15 15:28:27 2022] DELETE /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:28:27.426146 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-96f01b94-1030-4d11-8f13-0fdb3305463a tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:27.427083 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-96f01b94-1030-4d11-8f13-0fdb3305463a tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] [instance: 59fc0e3c-5238-40d8-a589-60ceb542cf30] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:27.434628 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-96f01b94-1030-4d11-8f13-0fdb3305463a tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:27.435070 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-96f01b94-1030-4d11-8f13-0fdb3305463a tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:27.436009 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-96f01b94-1030-4d11-8f13-0fdb3305463a tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:27.436431 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-96f01b94-1030-4d11-8f13-0fdb3305463a tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:27.454089 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-96f01b94-1030-4d11-8f13-0fdb3305463a tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] HTTP exception thrown: Instance 59fc0e3c-5238-40d8-a589-60ceb542cf30 could not be found. Jul 15 15:28:27.456727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-96f01b94-1030-4d11-8f13-0fdb3305463a tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Request method failure captured: Jul 15 15:28:27.456727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 HTTP/1.1 Jul 15 15:28:27.456727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:28:27.456727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:28:27.456727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:28:27.456727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 15 15:28:27.456727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:28:27.456727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:28:27.456727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:28:27.456727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:28:27.456727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0YctxPPgh2TFjFqb45Npe_zpj3vRDg1sS1LdWg3TN30GA7ZErGl1-5wG1dD02W8nN0UKbqrk4i-OUCSOi4EisioYWB6YkIapgabtb1gGJ3W0oTGfs9coLt1gp2TDgV1MVqTldNp9JVPZ1bLAlSYwnu15HesFrLDJhUxYiJ2bq3rx1ro Jul 15 15:28:27.456727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:28:27.456727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:28:27.456727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:28:27.456727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:28:27.456727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:28:27.456727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:28:27.456727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: f1097bdacbb44067bfa5dbf28bc86d9a Jul 15 15:28:27.456727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-DeleteServersTestJSON-1449665006 Jul 15 15:28:27.456727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:28:27.456727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:28:27.458185 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f1097bdacbb44067bfa5dbf28bc86d9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f1097bdacbb44067bfa5dbf28bc86d9a", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1097bdacbb44067bfa5dbf28bc86d9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1097bdacbb44067bfa5dbf28bc86d9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:28:27.458185 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-DeleteServersTestJSON-1449665006 Jul 15 15:28:27.458185 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: f1097bdacbb44067bfa5dbf28bc86d9a Jul 15 15:28:27.458185 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-DeleteServersTestJSON-1449665006 Jul 15 15:28:27.458185 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-DeleteServersTestJSON-1449665006-project Jul 15 15:28:27.458185 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:28:27.458185 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:28:27.458185 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: 2a01407bfc0a480a8f6702993ddb0183 Jul 15 15:28:27.458185 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-DeleteServersTestJSON-1449665006-project Jul 15 15:28:27.458185 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: > Jul 15 15:28:27.458185 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Instance 59fc0e3c-5238-40d8-a589-60ceb542cf30 could not be found. Jul 15 15:28:27.458185 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'id': '59fc0e3c-5238-40d8-a589-60ceb542cf30'} Jul 15 15:28:27.458991 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:28:27.458991 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:28:27.458991 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:28:27.458991 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:28:27.458991 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:28:27.458991 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:28:27.458991 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:28:27.458991 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:28:27.458991 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:28:27.458991 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:28:27.458991 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59fc0e3c-5238-40d8-a589-60ceb542cf30 could not be found. Jul 15 15:28:27.458991 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:28:27.458991 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:28:27.458991 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:28:27.458991 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:28:27.458991 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:28:27.458991 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:28:27.458991 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:28:27.458991 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:28:27.458991 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:28:27.460771 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:28:27.460771 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:28:27.460771 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:28:27.460771 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:28:27.460771 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:28:27.460771 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:28:27.460771 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:28:27.460771 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59fc0e3c-5238-40d8-a589-60ceb542cf30 could not be found. Jul 15 15:28:27.460771 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:28:27.460771 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:28:27.460771 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:28:27.460771 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:28:27.460771 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:28:27.460771 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:28:27.460771 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:28:27.460771 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:28:27.460771 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59fc0e3c-5238-40d8-a589-60ceb542cf30 could not be found. Jul 15 15:28:27.460771 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:28:27.463175 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-96f01b94-1030-4d11-8f13-0fdb3305463a tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] Returning 404 to user: Instance 59fc0e3c-5238-40d8-a589-60ceb542cf30 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:28:27.463175 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-96f01b94-1030-4d11-8f13-0fdb3305463a tempest-DeleteServersTestJSON-1449665006 tempest-DeleteServersTestJSON-1449665006-project] 10.222.0.40 "GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30" status: 404 len: 111 microversion: 2.1 time: 0.050794 Jul 15 15:28:27.463175 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 128/257] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:27 2022] GET /compute/v2.1/servers/59fc0e3c-5238-40d8-a589-60ceb542cf30 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:28:28.280331 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-c6a35de9-4258-438a-923b-806d280f4180 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:28.281400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-c6a35de9-4258-438a-923b-806d280f4180 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:28.291751 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c6a35de9-4258-438a-923b-806d280f4180 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:28.292246 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c6a35de9-4258-438a-923b-806d280f4180 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:28.293023 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c6a35de9-4258-438a-923b-806d280f4180 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:28.294726 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c6a35de9-4258-438a-923b-806d280f4180 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:28.507847 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-c6a35de9-4258-438a-923b-806d280f4180 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:28.529533 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-c6a35de9-4258-438a-923b-806d280f4180 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.260937 Jul 15 15:28:28.534947 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 130/258] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:28 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:29.553116 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d400fb40-d4ef-4097-b1cb-07c0b4d58401 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:29.553715 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d400fb40-d4ef-4097-b1cb-07c0b4d58401 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:29.564485 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d400fb40-d4ef-4097-b1cb-07c0b4d58401 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:29.579882 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d400fb40-d4ef-4097-b1cb-07c0b4d58401 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:29.580771 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d400fb40-d4ef-4097-b1cb-07c0b4d58401 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:29.581208 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d400fb40-d4ef-4097-b1cb-07c0b4d58401 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:29.629561 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:28:29.834638 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d400fb40-d4ef-4097-b1cb-07c0b4d58401 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:29.853301 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d400fb40-d4ef-4097-b1cb-07c0b4d58401 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.303705 Jul 15 15:28:29.868012 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 129/259] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:29 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:30.878833 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-f759571a-d291-4e4b-b482-6dbbabcba265 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:30.879731 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-f759571a-d291-4e4b-b482-6dbbabcba265 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:30.909520 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f759571a-d291-4e4b-b482-6dbbabcba265 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:30.911607 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f759571a-d291-4e4b-b482-6dbbabcba265 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:30.913242 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f759571a-d291-4e4b-b482-6dbbabcba265 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:30.914669 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f759571a-d291-4e4b-b482-6dbbabcba265 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:31.198490 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f759571a-d291-4e4b-b482-6dbbabcba265 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:31.212397 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-f759571a-d291-4e4b-b482-6dbbabcba265 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.339872 Jul 15 15:28:31.213690 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 131/260] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:30 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:32.232039 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-836544bb-3b54-4bc8-bfaa-6b47c56ab855 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:32.232949 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-836544bb-3b54-4bc8-bfaa-6b47c56ab855 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:32.250035 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-836544bb-3b54-4bc8-bfaa-6b47c56ab855 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:32.251749 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-836544bb-3b54-4bc8-bfaa-6b47c56ab855 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:32.253004 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-836544bb-3b54-4bc8-bfaa-6b47c56ab855 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:32.257480 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-836544bb-3b54-4bc8-bfaa-6b47c56ab855 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:32.726938 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-836544bb-3b54-4bc8-bfaa-6b47c56ab855 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:32.738257 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-836544bb-3b54-4bc8-bfaa-6b47c56ab855 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.511229 Jul 15 15:28:32.739085 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 130/261] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:32 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:33.773416 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-070f4fc3-2373-4730-b3f1-228bf5777101 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:33.774312 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-070f4fc3-2373-4730-b3f1-228bf5777101 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:33.782573 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-070f4fc3-2373-4730-b3f1-228bf5777101 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:33.783623 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-070f4fc3-2373-4730-b3f1-228bf5777101 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:33.784954 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-070f4fc3-2373-4730-b3f1-228bf5777101 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:33.785660 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-070f4fc3-2373-4730-b3f1-228bf5777101 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:34.047704 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-070f4fc3-2373-4730-b3f1-228bf5777101 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:34.061951 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-070f4fc3-2373-4730-b3f1-228bf5777101 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.302485 Jul 15 15:28:34.063418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 132/262] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:33 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:28:35.092515 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-52ca9c47-4a03-4d72-8918-bfe32a84a1dc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:35.096273 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-52ca9c47-4a03-4d72-8918-bfe32a84a1dc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:35.107650 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-52ca9c47-4a03-4d72-8918-bfe32a84a1dc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:35.108794 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-52ca9c47-4a03-4d72-8918-bfe32a84a1dc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:35.109885 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-52ca9c47-4a03-4d72-8918-bfe32a84a1dc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:35.110547 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-52ca9c47-4a03-4d72-8918-bfe32a84a1dc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:35.347036 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-52ca9c47-4a03-4d72-8918-bfe32a84a1dc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:35.362891 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-52ca9c47-4a03-4d72-8918-bfe32a84a1dc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.281291 Jul 15 15:28:35.377982 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 131/263] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:35 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:36.393997 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-9767f241-a0b4-4259-ada5-e998ec862e09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:36.396260 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-9767f241-a0b4-4259-ada5-e998ec862e09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:36.408575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9767f241-a0b4-4259-ada5-e998ec862e09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:36.409490 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9767f241-a0b4-4259-ada5-e998ec862e09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:36.410658 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9767f241-a0b4-4259-ada5-e998ec862e09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:36.411414 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9767f241-a0b4-4259-ada5-e998ec862e09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:36.599634 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-9767f241-a0b4-4259-ada5-e998ec862e09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:36.610927 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-9767f241-a0b4-4259-ada5-e998ec862e09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.221818 Jul 15 15:28:36.612438 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 133/264] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:36 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:37.637923 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d7713f16-ddbf-4cc3-a198-82d241776ddc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:37.639253 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d7713f16-ddbf-4cc3-a198-82d241776ddc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:37.647510 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d7713f16-ddbf-4cc3-a198-82d241776ddc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:37.647968 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d7713f16-ddbf-4cc3-a198-82d241776ddc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:37.648757 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d7713f16-ddbf-4cc3-a198-82d241776ddc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:37.649333 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d7713f16-ddbf-4cc3-a198-82d241776ddc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:37.842410 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d7713f16-ddbf-4cc3-a198-82d241776ddc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:37.857021 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d7713f16-ddbf-4cc3-a198-82d241776ddc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.223567 Jul 15 15:28:37.858827 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 132/265] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:37 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:38.882182 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-8827afdb-0a74-4786-91c2-8f2d7b7316bc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:38.882850 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-8827afdb-0a74-4786-91c2-8f2d7b7316bc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:38.890936 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8827afdb-0a74-4786-91c2-8f2d7b7316bc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:38.891629 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8827afdb-0a74-4786-91c2-8f2d7b7316bc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:38.892947 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8827afdb-0a74-4786-91c2-8f2d7b7316bc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:38.893693 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8827afdb-0a74-4786-91c2-8f2d7b7316bc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:38.902203 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=99 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:28:39.083134 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-8827afdb-0a74-4786-91c2-8f2d7b7316bc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:39.095751 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-8827afdb-0a74-4786-91c2-8f2d7b7316bc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.217499 Jul 15 15:28:39.096561 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 134/266] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:38 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:40.120424 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6324e1e8-dac4-4608-864b-9cc93aa7f7f3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:40.122901 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6324e1e8-dac4-4608-864b-9cc93aa7f7f3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:40.133231 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6324e1e8-dac4-4608-864b-9cc93aa7f7f3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:40.133712 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6324e1e8-dac4-4608-864b-9cc93aa7f7f3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:40.134666 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6324e1e8-dac4-4608-864b-9cc93aa7f7f3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:40.135269 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6324e1e8-dac4-4608-864b-9cc93aa7f7f3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:40.424135 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6324e1e8-dac4-4608-864b-9cc93aa7f7f3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:40.437611 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6324e1e8-dac4-4608-864b-9cc93aa7f7f3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.326162 Jul 15 15:28:40.449180 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 133/267] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:40 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:41.456267 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-bf904efb-c6c0-4c83-bd76-563f33e81e94 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:41.457226 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-bf904efb-c6c0-4c83-bd76-563f33e81e94 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:41.465923 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bf904efb-c6c0-4c83-bd76-563f33e81e94 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:41.466443 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bf904efb-c6c0-4c83-bd76-563f33e81e94 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:41.467579 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bf904efb-c6c0-4c83-bd76-563f33e81e94 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:41.468014 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bf904efb-c6c0-4c83-bd76-563f33e81e94 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:41.734566 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-bf904efb-c6c0-4c83-bd76-563f33e81e94 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:41.745327 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-bf904efb-c6c0-4c83-bd76-563f33e81e94 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.291423 Jul 15 15:28:41.745934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 135/268] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:41 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:28:42.774611 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3bf30b6e-3e6e-4080-bc0e-7b68b7876d19 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:42.782460 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3bf30b6e-3e6e-4080-bc0e-7b68b7876d19 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:42.790083 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3bf30b6e-3e6e-4080-bc0e-7b68b7876d19 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:42.791099 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3bf30b6e-3e6e-4080-bc0e-7b68b7876d19 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:42.791985 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3bf30b6e-3e6e-4080-bc0e-7b68b7876d19 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:42.792501 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3bf30b6e-3e6e-4080-bc0e-7b68b7876d19 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:43.031039 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3bf30b6e-3e6e-4080-bc0e-7b68b7876d19 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:43.054888 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3bf30b6e-3e6e-4080-bc0e-7b68b7876d19 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.288357 Jul 15 15:28:43.056292 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 134/269] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:42 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:44.076027 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-cb9ff5b6-2452-41dc-a382-2360a2c62eb9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:44.077553 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-cb9ff5b6-2452-41dc-a382-2360a2c62eb9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:44.089313 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cb9ff5b6-2452-41dc-a382-2360a2c62eb9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:44.090098 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cb9ff5b6-2452-41dc-a382-2360a2c62eb9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:44.091527 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cb9ff5b6-2452-41dc-a382-2360a2c62eb9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:44.092302 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cb9ff5b6-2452-41dc-a382-2360a2c62eb9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:44.301146 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-cb9ff5b6-2452-41dc-a382-2360a2c62eb9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:44.317377 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-cb9ff5b6-2452-41dc-a382-2360a2c62eb9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1522 microversion: 2.1 time: 0.247163 Jul 15 15:28:44.318536 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 136/270] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:44 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:45.347843 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-da99ed3a-817e-4fb7-9618-d23e5eb96479 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:45.348818 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-da99ed3a-817e-4fb7-9618-d23e5eb96479 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:45.355828 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-da99ed3a-817e-4fb7-9618-d23e5eb96479 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:45.356337 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-da99ed3a-817e-4fb7-9618-d23e5eb96479 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:45.357153 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-da99ed3a-817e-4fb7-9618-d23e5eb96479 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:45.357753 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-da99ed3a-817e-4fb7-9618-d23e5eb96479 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:45.708639 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-da99ed3a-817e-4fb7-9618-d23e5eb96479 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:45.719720 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-da99ed3a-817e-4fb7-9618-d23e5eb96479 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1502 microversion: 2.1 time: 0.375573 Jul 15 15:28:45.720878 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 135/271] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:45 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1502 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:45.737319 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-0250ec60-c8d5-4e9a-b038-a1c838ddedc1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:45.738055 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-0250ec60-c8d5-4e9a-b038-a1c838ddedc1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:45.745296 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0250ec60-c8d5-4e9a-b038-a1c838ddedc1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:45.745826 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0250ec60-c8d5-4e9a-b038-a1c838ddedc1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:45.746698 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0250ec60-c8d5-4e9a-b038-a1c838ddedc1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:45.747130 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0250ec60-c8d5-4e9a-b038-a1c838ddedc1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:45.919600 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-0250ec60-c8d5-4e9a-b038-a1c838ddedc1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:45.927938 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-0250ec60-c8d5-4e9a-b038-a1c838ddedc1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1516 microversion: 2.1 time: 0.194812 Jul 15 15:28:45.928512 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 137/272] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:45 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1516 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:28:48.551294 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6806bb98-21a9-4fc1-9c33-a12b54656cff tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:28:48.552865 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6806bb98-21a9-4fc1-9c33-a12b54656cff tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:48.564983 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6806bb98-21a9-4fc1-9c33-a12b54656cff tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:48.565820 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6806bb98-21a9-4fc1-9c33-a12b54656cff tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:48.567198 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6806bb98-21a9-4fc1-9c33-a12b54656cff tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:48.567985 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6806bb98-21a9-4fc1-9c33-a12b54656cff tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:48.612946 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.objects.instance [None req-6806bb98-21a9-4fc1-9c33-a12b54656cff tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lazy-loading 'flavor' on Instance uuid 021070dd-3943-48b0-a90a-b889e49029ae {{(pid=117998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:28:48.726417 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6806bb98-21a9-4fc1-9c33-a12b54656cff tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "POST /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae/action" status: 200 len: 32 microversion: 2.1 time: 0.181999 Jul 15 15:28:48.727615 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 136/273] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 15 15:28:48 2022] POST /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae/action => generated 32 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 15 15:28:48.741736 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3e675815-ab53-4432-99ec-abbbc751265c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:48.743107 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-3e675815-ab53-4432-99ec-abbbc751265c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:48.750963 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3e675815-ab53-4432-99ec-abbbc751265c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:48.751590 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3e675815-ab53-4432-99ec-abbbc751265c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:48.752529 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3e675815-ab53-4432-99ec-abbbc751265c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:48.753301 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3e675815-ab53-4432-99ec-abbbc751265c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:49.092151 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3e675815-ab53-4432-99ec-abbbc751265c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:49.107462 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-3e675815-ab53-4432-99ec-abbbc751265c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1522 microversion: 2.1 time: 0.371188 Jul 15 15:28:49.108047 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 138/274] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:48 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:28:50.142179 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-cd66f55a-962c-4280-acb2-4a0085fc035a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:50.143446 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-cd66f55a-962c-4280-acb2-4a0085fc035a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:50.153420 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cd66f55a-962c-4280-acb2-4a0085fc035a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:50.154686 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cd66f55a-962c-4280-acb2-4a0085fc035a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:50.155711 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cd66f55a-962c-4280-acb2-4a0085fc035a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:50.156346 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cd66f55a-962c-4280-acb2-4a0085fc035a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:50.419828 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-cd66f55a-962c-4280-acb2-4a0085fc035a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:50.432147 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-cd66f55a-962c-4280-acb2-4a0085fc035a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1522 microversion: 2.1 time: 0.297310 Jul 15 15:28:50.433669 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 137/275] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:50 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:28:51.454974 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-81aaea94-2070-41f9-9c57-537b957ea7c4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:51.455928 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-81aaea94-2070-41f9-9c57-537b957ea7c4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:51.465993 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-81aaea94-2070-41f9-9c57-537b957ea7c4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:51.466588 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-81aaea94-2070-41f9-9c57-537b957ea7c4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:51.467682 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-81aaea94-2070-41f9-9c57-537b957ea7c4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:51.468285 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-81aaea94-2070-41f9-9c57-537b957ea7c4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:51.683897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-81aaea94-2070-41f9-9c57-537b957ea7c4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:51.695531 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-81aaea94-2070-41f9-9c57-537b957ea7c4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1522 microversion: 2.1 time: 0.245559 Jul 15 15:28:51.696951 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 139/276] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:51 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:52.728568 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1417c5c3-17b4-47d2-abe1-21344a2fc24a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:52.729261 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1417c5c3-17b4-47d2-abe1-21344a2fc24a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:52.739605 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1417c5c3-17b4-47d2-abe1-21344a2fc24a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:52.740186 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1417c5c3-17b4-47d2-abe1-21344a2fc24a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:52.741485 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1417c5c3-17b4-47d2-abe1-21344a2fc24a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:52.742358 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1417c5c3-17b4-47d2-abe1-21344a2fc24a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:52.984602 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1417c5c3-17b4-47d2-abe1-21344a2fc24a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:52.994269 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1417c5c3-17b4-47d2-abe1-21344a2fc24a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1522 microversion: 2.1 time: 0.273342 Jul 15 15:28:52.994911 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 138/277] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:52 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:54.016026 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-a1ed4ef8-2bac-4090-b0fc-92668f2fdda3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:54.016891 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-a1ed4ef8-2bac-4090-b0fc-92668f2fdda3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:54.026876 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a1ed4ef8-2bac-4090-b0fc-92668f2fdda3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:54.027320 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a1ed4ef8-2bac-4090-b0fc-92668f2fdda3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:54.028078 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a1ed4ef8-2bac-4090-b0fc-92668f2fdda3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:54.028725 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a1ed4ef8-2bac-4090-b0fc-92668f2fdda3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:54.199006 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-a1ed4ef8-2bac-4090-b0fc-92668f2fdda3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:54.212856 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-a1ed4ef8-2bac-4090-b0fc-92668f2fdda3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1522 microversion: 2.1 time: 0.201298 Jul 15 15:28:54.214215 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 140/278] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:54 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:55.232116 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e8662a9d-b88d-420e-8c29-c8115f576f56 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:55.233103 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e8662a9d-b88d-420e-8c29-c8115f576f56 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:55.236969 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=26 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:28:55.247053 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e8662a9d-b88d-420e-8c29-c8115f576f56 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:55.247493 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e8662a9d-b88d-420e-8c29-c8115f576f56 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:55.248553 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e8662a9d-b88d-420e-8c29-c8115f576f56 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:55.249201 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e8662a9d-b88d-420e-8c29-c8115f576f56 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:55.463874 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e8662a9d-b88d-420e-8c29-c8115f576f56 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:55.473533 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e8662a9d-b88d-420e-8c29-c8115f576f56 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1522 microversion: 2.1 time: 0.246013 Jul 15 15:28:55.474507 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 139/279] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:55 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:56.517096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-97114452-36e3-4f04-aa29-d065e82265b9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:56.519153 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-97114452-36e3-4f04-aa29-d065e82265b9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:56.526099 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=26 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:28:56.528490 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-97114452-36e3-4f04-aa29-d065e82265b9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:56.528751 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-97114452-36e3-4f04-aa29-d065e82265b9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:56.529714 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-97114452-36e3-4f04-aa29-d065e82265b9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:56.530917 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-97114452-36e3-4f04-aa29-d065e82265b9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:56.761912 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-97114452-36e3-4f04-aa29-d065e82265b9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:56.785427 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-97114452-36e3-4f04-aa29-d065e82265b9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1522 microversion: 2.1 time: 0.288363 Jul 15 15:28:56.786332 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 141/280] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:56 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:57.809753 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b5e72a0a-cdda-4678-90f4-1c049fd21a51 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:57.811825 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b5e72a0a-cdda-4678-90f4-1c049fd21a51 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:57.821931 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b5e72a0a-cdda-4678-90f4-1c049fd21a51 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:57.822854 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b5e72a0a-cdda-4678-90f4-1c049fd21a51 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:57.824288 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b5e72a0a-cdda-4678-90f4-1c049fd21a51 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:57.825123 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b5e72a0a-cdda-4678-90f4-1c049fd21a51 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:58.109646 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b5e72a0a-cdda-4678-90f4-1c049fd21a51 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:58.125715 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b5e72a0a-cdda-4678-90f4-1c049fd21a51 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1522 microversion: 2.1 time: 0.322288 Jul 15 15:28:58.136350 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 140/281] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:57 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:28:59.156711 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-7452f18c-1001-4155-83f9-39df95e87b56 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:28:59.157813 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-7452f18c-1001-4155-83f9-39df95e87b56 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:28:59.171618 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7452f18c-1001-4155-83f9-39df95e87b56 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:59.172654 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7452f18c-1001-4155-83f9-39df95e87b56 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:59.175880 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7452f18c-1001-4155-83f9-39df95e87b56 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:28:59.176868 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7452f18c-1001-4155-83f9-39df95e87b56 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:28:59.434250 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-7452f18c-1001-4155-83f9-39df95e87b56 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:28:59.443599 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-7452f18c-1001-4155-83f9-39df95e87b56 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1522 microversion: 2.1 time: 0.295719 Jul 15 15:28:59.444184 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 142/282] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:28:59 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:00.476704 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-01047822-6354-4d1d-999d-d2d8a7c98667 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:00.477841 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-01047822-6354-4d1d-999d-d2d8a7c98667 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:00.492052 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-01047822-6354-4d1d-999d-d2d8a7c98667 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:00.492052 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-01047822-6354-4d1d-999d-d2d8a7c98667 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:00.493014 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-01047822-6354-4d1d-999d-d2d8a7c98667 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:00.493958 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-01047822-6354-4d1d-999d-d2d8a7c98667 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:00.501924 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:00.874934 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-01047822-6354-4d1d-999d-d2d8a7c98667 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:00.887109 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-01047822-6354-4d1d-999d-d2d8a7c98667 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1522 microversion: 2.1 time: 0.418756 Jul 15 15:29:00.887822 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 141/283] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:00 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:01.909852 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-6b248b02-619c-459a-b5a5-bd97a92bd51b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:01.910920 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-6b248b02-619c-459a-b5a5-bd97a92bd51b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:01.922263 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6b248b02-619c-459a-b5a5-bd97a92bd51b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:01.922755 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6b248b02-619c-459a-b5a5-bd97a92bd51b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:01.923923 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6b248b02-619c-459a-b5a5-bd97a92bd51b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:01.924954 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6b248b02-619c-459a-b5a5-bd97a92bd51b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:02.154263 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6b248b02-619c-459a-b5a5-bd97a92bd51b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:02.167934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-6b248b02-619c-459a-b5a5-bd97a92bd51b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1522 microversion: 2.1 time: 0.264521 Jul 15 15:29:02.168863 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 143/284] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:01 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:29:03.189517 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f86405a9-3154-45e2-bd41-999c05451828 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:03.190652 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f86405a9-3154-45e2-bd41-999c05451828 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:03.209425 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f86405a9-3154-45e2-bd41-999c05451828 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:03.209425 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f86405a9-3154-45e2-bd41-999c05451828 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:03.209425 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f86405a9-3154-45e2-bd41-999c05451828 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:03.209425 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f86405a9-3154-45e2-bd41-999c05451828 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:03.406129 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f86405a9-3154-45e2-bd41-999c05451828 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:03.414311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f86405a9-3154-45e2-bd41-999c05451828 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1522 microversion: 2.1 time: 0.232261 Jul 15 15:29:03.414933 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 142/285] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:03 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:04.390352 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-4d1d2c52-21eb-4d23-9e9d-c2252c803dfd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1392449066", "imageRef": "b9770891-ef3b-4f53-a989-3a4db420d5c5", "flavorRef": "452", "networks": [{"uuid": "2d94ac5f-d69c-4bd9-bf90-62f0b5439444"}]}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:29:04.432085 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b37a4fa9-6fce-430c-b6aa-857e85f084d3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:04.432731 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b37a4fa9-6fce-430c-b6aa-857e85f084d3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:04.439338 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b37a4fa9-6fce-430c-b6aa-857e85f084d3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:04.439782 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b37a4fa9-6fce-430c-b6aa-857e85f084d3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:04.440547 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b37a4fa9-6fce-430c-b6aa-857e85f084d3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:04.440973 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b37a4fa9-6fce-430c-b6aa-857e85f084d3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:04.459631 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.network.neutron [None req-4d1d2c52-21eb-4d23-9e9d-c2252c803dfd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] validate_networks() for [('2d94ac5f-d69c-4bd9-bf90-62f0b5439444', None, None, None, None, None)] {{(pid=117999) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:29:04.698910 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b37a4fa9-6fce-430c-b6aa-857e85f084d3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:04.707960 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b37a4fa9-6fce-430c-b6aa-857e85f084d3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1522 microversion: 2.1 time: 0.280098 Jul 15 15:29:04.708599 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 143/286] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:04 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:04.979299 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-4d1d2c52-21eb-4d23-9e9d-c2252c803dfd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Flavor limits 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:29:04.979729 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-4d1d2c52-21eb-4d23-9e9d-c2252c803dfd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Image limits 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:29:04.980197 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-4d1d2c52-21eb-4d23-9e9d-c2252c803dfd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Flavor pref 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:29:04.980594 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-4d1d2c52-21eb-4d23-9e9d-c2252c803dfd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Image pref 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:29:04.981673 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-4d1d2c52-21eb-4d23-9e9d-c2252c803dfd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:29:04.995626 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4d1d2c52-21eb-4d23-9e9d-c2252c803dfd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:04.996052 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4d1d2c52-21eb-4d23-9e9d-c2252c803dfd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:04.996829 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4d1d2c52-21eb-4d23-9e9d-c2252c803dfd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:04.997244 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4d1d2c52-21eb-4d23-9e9d-c2252c803dfd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:05.015885 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-4d1d2c52-21eb-4d23-9e9d-c2252c803dfd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Getting quotas for project 7987f63707dc436c837b81c9c7e32888. Resources: {'ram', 'instances', 'cores'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:29:05.020309 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-4d1d2c52-21eb-4d23-9e9d-c2252c803dfd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Getting quotas for user 8b113432fd9d4e4dafc74874a12364a6 and project 7987f63707dc436c837b81c9c7e32888. Resources: {'ram', 'instances', 'cores'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:29:05.033647 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-4d1d2c52-21eb-4d23-9e9d-c2252c803dfd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Going to run 1 instances... {{(pid=117999) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:29:05.036096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-4d1d2c52-21eb-4d23-9e9d-c2252c803dfd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9770891-ef3b-4f53-a989-3a4db420d5c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117999) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:29:05.101888 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-4d1d2c52-21eb-4d23-9e9d-c2252c803dfd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.715415 Jul 15 15:29:05.102998 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 144/287] 10.222.0.40 () {60 vars in 1146 bytes} [Fri Jul 15 15:29:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 15 15:29:05.116777 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7e545703-5a6c-4aa8-8e2f-ee6d06f3be71 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:05.119286 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7e545703-5a6c-4aa8-8e2f-ee6d06f3be71 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:05.199055 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7e545703-5a6c-4aa8-8e2f-ee6d06f3be71 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:05.206325 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7e545703-5a6c-4aa8-8e2f-ee6d06f3be71 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1214 microversion: 2.1 time: 0.095107 Jul 15 15:29:05.206949 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 144/288] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:05 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:05.728007 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-4d0a01df-4dbc-44f8-8fd2-6245aed3c888 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:05.728997 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-4d0a01df-4dbc-44f8-8fd2-6245aed3c888 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:05.735987 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4d0a01df-4dbc-44f8-8fd2-6245aed3c888 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:05.736501 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4d0a01df-4dbc-44f8-8fd2-6245aed3c888 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:05.737309 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4d0a01df-4dbc-44f8-8fd2-6245aed3c888 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:05.737777 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4d0a01df-4dbc-44f8-8fd2-6245aed3c888 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:05.901969 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-4d0a01df-4dbc-44f8-8fd2-6245aed3c888 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:05.916095 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-4d0a01df-4dbc-44f8-8fd2-6245aed3c888 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1522 microversion: 2.1 time: 0.192188 Jul 15 15:29:05.917154 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 145/289] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:05 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:06.230604 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-be3a3045-e4dd-451f-8c12-529566bb8bca tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:06.231495 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-be3a3045-e4dd-451f-8c12-529566bb8bca tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:06.240210 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-be3a3045-e4dd-451f-8c12-529566bb8bca tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:06.240802 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-be3a3045-e4dd-451f-8c12-529566bb8bca tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:06.241795 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-be3a3045-e4dd-451f-8c12-529566bb8bca tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:06.242323 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-be3a3045-e4dd-451f-8c12-529566bb8bca tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:06.315795 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-be3a3045-e4dd-451f-8c12-529566bb8bca tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:06.324243 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-be3a3045-e4dd-451f-8c12-529566bb8bca tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1218 microversion: 2.1 time: 0.098219 Jul 15 15:29:06.324838 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 145/290] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:06 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:06.936768 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-0643b461-c7f8-46d8-805d-6304692000e7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:06.937614 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-0643b461-c7f8-46d8-805d-6304692000e7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:06.947667 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0643b461-c7f8-46d8-805d-6304692000e7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:06.948520 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0643b461-c7f8-46d8-805d-6304692000e7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:06.949955 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0643b461-c7f8-46d8-805d-6304692000e7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:06.950468 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0643b461-c7f8-46d8-805d-6304692000e7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:07.153722 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-0643b461-c7f8-46d8-805d-6304692000e7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:07.168449 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-0643b461-c7f8-46d8-805d-6304692000e7 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1522 microversion: 2.1 time: 0.236793 Jul 15 15:29:07.169302 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 146/291] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:06 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:29:07.345732 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d4618e57-0a6a-4ea7-bab1-248b802e3dda tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:07.346377 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d4618e57-0a6a-4ea7-bab1-248b802e3dda tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:07.353738 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d4618e57-0a6a-4ea7-bab1-248b802e3dda tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:07.354178 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d4618e57-0a6a-4ea7-bab1-248b802e3dda tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:07.354994 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d4618e57-0a6a-4ea7-bab1-248b802e3dda tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:07.355398 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d4618e57-0a6a-4ea7-bab1-248b802e3dda tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:07.422116 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d4618e57-0a6a-4ea7-bab1-248b802e3dda tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:07.430562 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d4618e57-0a6a-4ea7-bab1-248b802e3dda tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1218 microversion: 2.1 time: 0.090070 Jul 15 15:29:07.431155 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 146/292] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:07 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:08.186336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-900e513b-5ae9-4e9a-b24b-56bfd897986c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:08.187027 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-900e513b-5ae9-4e9a-b24b-56bfd897986c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:08.193829 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-900e513b-5ae9-4e9a-b24b-56bfd897986c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:08.194397 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-900e513b-5ae9-4e9a-b24b-56bfd897986c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:08.195721 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-900e513b-5ae9-4e9a-b24b-56bfd897986c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:08.196275 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-900e513b-5ae9-4e9a-b24b-56bfd897986c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:08.353933 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-900e513b-5ae9-4e9a-b24b-56bfd897986c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:08.363117 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-900e513b-5ae9-4e9a-b24b-56bfd897986c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1522 microversion: 2.1 time: 0.180641 Jul 15 15:29:08.363703 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 147/293] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:08 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:08.454396 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2a0e862c-92d4-469d-8083-41d6090e962a tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:08.455924 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-2a0e862c-92d4-469d-8083-41d6090e962a tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:08.466999 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2a0e862c-92d4-469d-8083-41d6090e962a tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:08.467437 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2a0e862c-92d4-469d-8083-41d6090e962a tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:08.468227 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2a0e862c-92d4-469d-8083-41d6090e962a tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:08.468684 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2a0e862c-92d4-469d-8083-41d6090e962a tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:08.546877 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2a0e862c-92d4-469d-8083-41d6090e962a tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:08.555281 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-2a0e862c-92d4-469d-8083-41d6090e962a tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1218 microversion: 2.1 time: 0.110398 Jul 15 15:29:08.555896 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 147/294] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:08 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:09.385289 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3c3950c1-cfad-41c8-a918-6f5c4a222466 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:09.386045 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-3c3950c1-cfad-41c8-a918-6f5c4a222466 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:09.395659 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3c3950c1-cfad-41c8-a918-6f5c4a222466 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:09.396446 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3c3950c1-cfad-41c8-a918-6f5c4a222466 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:09.397892 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3c3950c1-cfad-41c8-a918-6f5c4a222466 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:09.398662 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3c3950c1-cfad-41c8-a918-6f5c4a222466 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:09.402184 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=80 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:09.574825 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d459acbc-360a-4c30-bcdd-37ab6eba0bb7 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:09.575667 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d459acbc-360a-4c30-bcdd-37ab6eba0bb7 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:09.583767 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d459acbc-360a-4c30-bcdd-37ab6eba0bb7 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:09.584240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d459acbc-360a-4c30-bcdd-37ab6eba0bb7 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:09.585529 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d459acbc-360a-4c30-bcdd-37ab6eba0bb7 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:09.585978 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d459acbc-360a-4c30-bcdd-37ab6eba0bb7 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:09.590420 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3c3950c1-cfad-41c8-a918-6f5c4a222466 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:09.600492 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-3c3950c1-cfad-41c8-a918-6f5c4a222466 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1522 microversion: 2.1 time: 0.221852 Jul 15 15:29:09.607428 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 148/295] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:09 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:09.671238 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d459acbc-360a-4c30-bcdd-37ab6eba0bb7 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:09.680007 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d459acbc-360a-4c30-bcdd-37ab6eba0bb7 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1218 microversion: 2.1 time: 0.109526 Jul 15 15:29:09.680808 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 148/296] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:09 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:10.628991 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-e8754c45-57a2-40dd-9a45-95c55cd83a7f tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:10.629774 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-e8754c45-57a2-40dd-9a45-95c55cd83a7f tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:10.636960 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e8754c45-57a2-40dd-9a45-95c55cd83a7f tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:10.637388 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e8754c45-57a2-40dd-9a45-95c55cd83a7f tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:10.638472 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e8754c45-57a2-40dd-9a45-95c55cd83a7f tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:10.638924 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e8754c45-57a2-40dd-9a45-95c55cd83a7f tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:10.702827 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b78cb66a-e397-4b1e-a1ec-5da94a4ba719 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:10.703665 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b78cb66a-e397-4b1e-a1ec-5da94a4ba719 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:10.713256 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b78cb66a-e397-4b1e-a1ec-5da94a4ba719 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:10.714075 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b78cb66a-e397-4b1e-a1ec-5da94a4ba719 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:10.715551 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b78cb66a-e397-4b1e-a1ec-5da94a4ba719 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:10.716486 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b78cb66a-e397-4b1e-a1ec-5da94a4ba719 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:10.815329 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b78cb66a-e397-4b1e-a1ec-5da94a4ba719 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:10.822294 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e8754c45-57a2-40dd-9a45-95c55cd83a7f tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:10.827831 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b78cb66a-e397-4b1e-a1ec-5da94a4ba719 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1218 microversion: 2.1 time: 0.131126 Jul 15 15:29:10.829052 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 149/297] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:10 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1218 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:10.831363 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-e8754c45-57a2-40dd-9a45-95c55cd83a7f tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1522 microversion: 2.1 time: 0.207817 Jul 15 15:29:10.832314 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 149/298] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:10 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:29:11.849907 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f31552c4-b343-4578-979c-4f7c102111f4 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:11.850923 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f31552c4-b343-4578-979c-4f7c102111f4 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:11.851391 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3b0541a9-2bc8-44f1-9e6c-26e0cf4a5a09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:11.852226 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-3b0541a9-2bc8-44f1-9e6c-26e0cf4a5a09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:11.862610 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f31552c4-b343-4578-979c-4f7c102111f4 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:11.863513 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f31552c4-b343-4578-979c-4f7c102111f4 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:11.864053 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3b0541a9-2bc8-44f1-9e6c-26e0cf4a5a09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:11.864761 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3b0541a9-2bc8-44f1-9e6c-26e0cf4a5a09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:11.864950 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f31552c4-b343-4578-979c-4f7c102111f4 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:11.866049 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f31552c4-b343-4578-979c-4f7c102111f4 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:11.866230 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3b0541a9-2bc8-44f1-9e6c-26e0cf4a5a09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:11.866937 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3b0541a9-2bc8-44f1-9e6c-26e0cf4a5a09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:11.978100 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f31552c4-b343-4578-979c-4f7c102111f4 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:11.995322 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f31552c4-b343-4578-979c-4f7c102111f4 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1218 microversion: 2.1 time: 0.150851 Jul 15 15:29:12.005071 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 150/299] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:11 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1218 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:12.057136 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3b0541a9-2bc8-44f1-9e6c-26e0cf4a5a09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:12.067544 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-3b0541a9-2bc8-44f1-9e6c-26e0cf4a5a09 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1522 microversion: 2.1 time: 0.221088 Jul 15 15:29:12.068467 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 150/300] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:11 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:29:13.013173 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-732fa013-a0fb-4a26-b35a-4e5f8f31a7be tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:13.013825 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-732fa013-a0fb-4a26-b35a-4e5f8f31a7be tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:13.020802 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-732fa013-a0fb-4a26-b35a-4e5f8f31a7be tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:13.021647 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-732fa013-a0fb-4a26-b35a-4e5f8f31a7be tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:13.022041 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-732fa013-a0fb-4a26-b35a-4e5f8f31a7be tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:13.022686 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-732fa013-a0fb-4a26-b35a-4e5f8f31a7be tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:13.087389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-d595c121-96ce-4843-85a5-4476e6fec2fc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:13.088075 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-d595c121-96ce-4843-85a5-4476e6fec2fc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:13.092372 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-732fa013-a0fb-4a26-b35a-4e5f8f31a7be tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:13.094724 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d595c121-96ce-4843-85a5-4476e6fec2fc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:13.095166 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d595c121-96ce-4843-85a5-4476e6fec2fc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:13.096108 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d595c121-96ce-4843-85a5-4476e6fec2fc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:13.096826 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d595c121-96ce-4843-85a5-4476e6fec2fc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:13.104550 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-732fa013-a0fb-4a26-b35a-4e5f8f31a7be tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1218 microversion: 2.1 time: 0.095833 Jul 15 15:29:13.105758 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 151/301] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:13 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:13.303020 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-d595c121-96ce-4843-85a5-4476e6fec2fc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:13.311876 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-d595c121-96ce-4843-85a5-4476e6fec2fc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1522 microversion: 2.1 time: 0.230336 Jul 15 15:29:13.312916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 151/302] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:13 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:14.127428 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2ec777d1-1921-471f-bf88-8ea11f84b675 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:14.128370 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-2ec777d1-1921-471f-bf88-8ea11f84b675 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:14.138601 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2ec777d1-1921-471f-bf88-8ea11f84b675 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:14.138876 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2ec777d1-1921-471f-bf88-8ea11f84b675 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:14.139809 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2ec777d1-1921-471f-bf88-8ea11f84b675 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:14.140037 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2ec777d1-1921-471f-bf88-8ea11f84b675 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:14.237988 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2ec777d1-1921-471f-bf88-8ea11f84b675 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:14.250714 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-2ec777d1-1921-471f-bf88-8ea11f84b675 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1210 microversion: 2.1 time: 0.127400 Jul 15 15:29:14.251481 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 152/303] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:14 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1210 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:14.331085 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-26923d18-966f-482c-84b6-3f21531ebc8e tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:14.331690 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-26923d18-966f-482c-84b6-3f21531ebc8e tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:14.344492 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-26923d18-966f-482c-84b6-3f21531ebc8e tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:14.345298 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-26923d18-966f-482c-84b6-3f21531ebc8e tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:14.346188 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-26923d18-966f-482c-84b6-3f21531ebc8e tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:14.347361 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-26923d18-966f-482c-84b6-3f21531ebc8e tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:14.508220 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-26923d18-966f-482c-84b6-3f21531ebc8e tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:14.517668 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-26923d18-966f-482c-84b6-3f21531ebc8e tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1522 microversion: 2.1 time: 0.190885 Jul 15 15:29:14.518462 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 152/304] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:14 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:15.271176 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4d6fa3cc-be63-4f7b-af5b-ca2e8fe68567 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:15.272005 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-4d6fa3cc-be63-4f7b-af5b-ca2e8fe68567 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:15.274618 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:15.281198 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4d6fa3cc-be63-4f7b-af5b-ca2e8fe68567 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:15.281638 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4d6fa3cc-be63-4f7b-af5b-ca2e8fe68567 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:15.282422 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4d6fa3cc-be63-4f7b-af5b-ca2e8fe68567 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:15.282914 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4d6fa3cc-be63-4f7b-af5b-ca2e8fe68567 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:15.359851 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-4d6fa3cc-be63-4f7b-af5b-ca2e8fe68567 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:15.368255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4d6fa3cc-be63-4f7b-af5b-ca2e8fe68567 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1210 microversion: 2.1 time: 0.101750 Jul 15 15:29:15.368878 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 153/305] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:15 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1210 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:15.536760 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-08207366-07c7-4aa3-8160-24a19510d166 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:15.537702 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-08207366-07c7-4aa3-8160-24a19510d166 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:15.539907 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=2 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:15.540582 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=6 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:15.549607 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-08207366-07c7-4aa3-8160-24a19510d166 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:15.550167 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-08207366-07c7-4aa3-8160-24a19510d166 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:15.550934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-08207366-07c7-4aa3-8160-24a19510d166 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:15.551350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-08207366-07c7-4aa3-8160-24a19510d166 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:15.721389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-08207366-07c7-4aa3-8160-24a19510d166 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:15.730729 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-08207366-07c7-4aa3-8160-24a19510d166 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1522 microversion: 2.1 time: 0.198316 Jul 15 15:29:15.731331 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 153/306] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:15 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:16.385739 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-84794425-2f8a-4736-b8ae-f07985873e2f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:16.386315 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-84794425-2f8a-4736-b8ae-f07985873e2f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:16.393515 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-84794425-2f8a-4736-b8ae-f07985873e2f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:16.393954 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-84794425-2f8a-4736-b8ae-f07985873e2f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:16.394759 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-84794425-2f8a-4736-b8ae-f07985873e2f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:16.395189 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-84794425-2f8a-4736-b8ae-f07985873e2f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:16.476372 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-84794425-2f8a-4736-b8ae-f07985873e2f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:16.490099 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-84794425-2f8a-4736-b8ae-f07985873e2f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1266 microversion: 2.1 time: 0.108239 Jul 15 15:29:16.491572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 154/307] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:16 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1266 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:16.751095 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-23d98678-d21a-4ec8-ae42-8ba5cba530ce tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:16.752088 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-23d98678-d21a-4ec8-ae42-8ba5cba530ce tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:16.760772 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-23d98678-d21a-4ec8-ae42-8ba5cba530ce tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:16.761261 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-23d98678-d21a-4ec8-ae42-8ba5cba530ce tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:16.762821 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-23d98678-d21a-4ec8-ae42-8ba5cba530ce tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:16.763311 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-23d98678-d21a-4ec8-ae42-8ba5cba530ce tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:16.922387 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-23d98678-d21a-4ec8-ae42-8ba5cba530ce tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:16.930875 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-23d98678-d21a-4ec8-ae42-8ba5cba530ce tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1502 microversion: 2.1 time: 0.185938 Jul 15 15:29:16.931639 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 154/308] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:16 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1502 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:16.954013 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c18e8e08-2119-4b17-9943-0b878f45e63d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2379940-367b-4361-8579-9a53cb60f5a5"}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:29:16.955162 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-c18e8e08-2119-4b17-9943-0b878f45e63d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:16.961929 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c18e8e08-2119-4b17-9943-0b878f45e63d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:16.963910 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c18e8e08-2119-4b17-9943-0b878f45e63d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:16.963910 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c18e8e08-2119-4b17-9943-0b878f45e63d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:16.963910 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c18e8e08-2119-4b17-9943-0b878f45e63d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:16.989765 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-c18e8e08-2119-4b17-9943-0b878f45e63d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] HTTP exception thrown: Cannot 'attach_volume' instance 021070dd-3943-48b0-a90a-b889e49029ae while it is in vm_state rescued Jul 15 15:29:16.991572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c18e8e08-2119-4b17-9943-0b878f45e63d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Request method failure captured: Jul 15 15:29:16.991572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: POST /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae/os-volume_attachments HTTP/1.1 Jul 15 15:29:16.991572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:29:16.991572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:29:16.991572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:29:16.991572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 74 Jul 15 15:29:16.991572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:29:16.991572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:29:16.991572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:29:16.991572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:29:16.991572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0YcsFZkCZjkBbmSTXB7UwekvD5WNzeaEbNt0rITlIw_1hzYJxVEjCSvTE3Iz-khRfNW59h8CDuHoTt68mQeVPMhdAmhxbIqofx4vXjqK5T_vcExmq4CdFYJ8LNVUNZ_zMmgWfaeigTLlD9bCaozXsDQmwZpOGCKkhLeeXY2KxB1RuxI Jul 15 15:29:16.991572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:29:16.991572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:29:16.991572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:29:16.991572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:29:16.991572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:29:16.991572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:29:16.991572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: 1e21747a454c4ebebb5d48b5906d5e5c Jul 15 15:29:16.991572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2035142133 Jul 15 15:29:16.991572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:29:16.991572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:29:16.993601 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1e21747a454c4ebebb5d48b5906d5e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1e21747a454c4ebebb5d48b5906d5e5c", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1e21747a454c4ebebb5d48b5906d5e5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1e21747a454c4ebebb5d48b5906d5e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:29:16.993601 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2035142133 Jul 15 15:29:16.993601 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 1e21747a454c4ebebb5d48b5906d5e5c Jul 15 15:29:16.993601 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2035142133 Jul 15 15:29:16.993601 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-ServerRescueNegativeTestJSON-2035142133-project Jul 15 15:29:16.993601 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:29:16.993601 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:29:16.993601 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: c1a1af21d3f94b70a830b14200619f87 Jul 15 15:29:16.993601 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2035142133-project Jul 15 15:29:16.993601 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Jul 15 15:29:16.993601 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {"volumeAttachment": {"volumeId": "b2379940-367b-4361-8579-9a53cb60f5a5"}} Jul 15 15:29:16.993601 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: > Jul 15 15:29:16.994375 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Cannot 'attach_volume' instance 021070dd-3943-48b0-a90a-b889e49029ae while it is in vm_state rescued Jul 15 15:29:16.994375 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'server_id': '021070dd-3943-48b0-a90a-b889e49029ae', 'body': {'volumeAttachment': {'volumeId': 'b2379940-367b-4361-8579-9a53cb60f5a5'}}} Jul 15 15:29:16.994375 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:29:16.994375 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:29:16.994375 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 15 15:29:16.994375 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 15 15:29:16.994375 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 15 15:29:16.994375 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 15 15:29:16.994375 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 15 15:29:16.994375 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 15 15:29:16.994375 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 021070dd-3943-48b0-a90a-b889e49029ae in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 15 15:29:16.994375 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:29:16.994375 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:29:16.994375 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:29:16.994375 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:29:16.994375 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:29:16.994375 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:29:16.994375 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:29:16.994375 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:29:16.995604 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:29:16.995604 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:29:16.995604 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 15:29:16.995604 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 15:29:16.995604 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 15:29:16.995604 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 15:29:16.995604 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 15:29:16.995604 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 15:29:16.995604 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 15 15:29:16.995604 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 15 15:29:16.995604 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 15 15:29:16.995604 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 15 15:29:16.995604 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 021070dd-3943-48b0-a90a-b889e49029ae while it is in vm_state rescued Jul 15 15:29:16.995604 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:29:16.995604 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:29:16.995604 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:29:16.995604 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:29:16.995604 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:29:16.995604 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:29:16.996702 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:29:16.996702 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:29:16.996702 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 021070dd-3943-48b0-a90a-b889e49029ae while it is in vm_state rescued Jul 15 15:29:16.996702 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:29:16.996702 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c18e8e08-2119-4b17-9943-0b878f45e63d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Returning 409 to user: Cannot 'attach_volume' instance 021070dd-3943-48b0-a90a-b889e49029ae while it is in vm_state rescued {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:29:16.996702 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-c18e8e08-2119-4b17-9943-0b878f45e63d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "POST /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043139 Jul 15 15:29:16.996702 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 155/309] 10.222.0.40 () {60 vars in 1322 bytes} [Fri Jul 15 15:29:16 2022] POST /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 15 15:29:17.002379 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-436dd3cb-458c-4bd7-a4eb-f385fc10b3ec tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:29:17.003026 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-436dd3cb-458c-4bd7-a4eb-f385fc10b3ec tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:17.009509 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-436dd3cb-458c-4bd7-a4eb-f385fc10b3ec tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:17.009944 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-436dd3cb-458c-4bd7-a4eb-f385fc10b3ec tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:17.010762 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-436dd3cb-458c-4bd7-a4eb-f385fc10b3ec tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:17.011192 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-436dd3cb-458c-4bd7-a4eb-f385fc10b3ec tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:17.105223 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-436dd3cb-458c-4bd7-a4eb-f385fc10b3ec tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "POST /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae/action" status: 202 len: 0 microversion: 2.1 time: 0.106581 Jul 15 15:29:17.106328 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 155/310] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 15 15:29:16 2022] POST /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:29:17.114686 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2268aa22-a689-443b-928a-e2e566bc2822 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:17.115373 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-2268aa22-a689-443b-928a-e2e566bc2822 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:17.122611 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2268aa22-a689-443b-928a-e2e566bc2822 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:17.123045 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2268aa22-a689-443b-928a-e2e566bc2822 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:17.123917 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2268aa22-a689-443b-928a-e2e566bc2822 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:17.124519 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2268aa22-a689-443b-928a-e2e566bc2822 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:17.311671 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2268aa22-a689-443b-928a-e2e566bc2822 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:17.322002 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-2268aa22-a689-443b-928a-e2e566bc2822 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1510 microversion: 2.1 time: 0.209820 Jul 15 15:29:17.322002 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 156/311] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:17 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1510 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:17.532971 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-dcfedaef-bc0d-410c-aee6-bdea94365bbb tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:17.533715 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-dcfedaef-bc0d-410c-aee6-bdea94365bbb tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:17.543089 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-dcfedaef-bc0d-410c-aee6-bdea94365bbb tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:17.545435 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-dcfedaef-bc0d-410c-aee6-bdea94365bbb tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:17.547288 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-dcfedaef-bc0d-410c-aee6-bdea94365bbb tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:17.547816 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-dcfedaef-bc0d-410c-aee6-bdea94365bbb tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:17.741344 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-dcfedaef-bc0d-410c-aee6-bdea94365bbb tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:17.750232 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-dcfedaef-bc0d-410c-aee6-bdea94365bbb tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1274 microversion: 2.1 time: 0.235007 Jul 15 15:29:17.751541 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 156/312] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:17 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1274 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:18.349546 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b7d79da3-5d34-49c2-905d-d01557a8b4a6 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:18.353586 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b7d79da3-5d34-49c2-905d-d01557a8b4a6 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:18.373603 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b7d79da3-5d34-49c2-905d-d01557a8b4a6 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:18.376018 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b7d79da3-5d34-49c2-905d-d01557a8b4a6 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:18.377880 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b7d79da3-5d34-49c2-905d-d01557a8b4a6 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:18.380462 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b7d79da3-5d34-49c2-905d-d01557a8b4a6 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:18.767951 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b7d79da3-5d34-49c2-905d-d01557a8b4a6 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:18.777823 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-0e603d8b-4943-4a1e-b421-0b5bdd068fbb tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:18.779106 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-0e603d8b-4943-4a1e-b421-0b5bdd068fbb tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:18.779764 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b7d79da3-5d34-49c2-905d-d01557a8b4a6 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1510 microversion: 2.1 time: 0.441263 Jul 15 15:29:18.780346 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 157/313] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:18 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1510 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:18.787403 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0e603d8b-4943-4a1e-b421-0b5bdd068fbb tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:18.789087 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0e603d8b-4943-4a1e-b421-0b5bdd068fbb tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:18.789968 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0e603d8b-4943-4a1e-b421-0b5bdd068fbb tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:18.790422 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0e603d8b-4943-4a1e-b421-0b5bdd068fbb tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:18.878019 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-0e603d8b-4943-4a1e-b421-0b5bdd068fbb tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:18.886114 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-0e603d8b-4943-4a1e-b421-0b5bdd068fbb tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1272 microversion: 2.1 time: 0.112449 Jul 15 15:29:18.886730 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 157/314] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:18 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1272 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:19.798416 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6d993d5a-5dbc-4ec8-af07-816a2f588260 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:19.799324 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6d993d5a-5dbc-4ec8-af07-816a2f588260 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:19.807594 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6d993d5a-5dbc-4ec8-af07-816a2f588260 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:19.808181 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6d993d5a-5dbc-4ec8-af07-816a2f588260 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:19.809426 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6d993d5a-5dbc-4ec8-af07-816a2f588260 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:19.810173 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6d993d5a-5dbc-4ec8-af07-816a2f588260 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:19.907578 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-b95cc112-8e3f-41c2-9e27-381944066f1f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:19.908310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-b95cc112-8e3f-41c2-9e27-381944066f1f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:19.915380 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b95cc112-8e3f-41c2-9e27-381944066f1f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:19.915796 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b95cc112-8e3f-41c2-9e27-381944066f1f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:19.916605 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b95cc112-8e3f-41c2-9e27-381944066f1f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:19.917023 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b95cc112-8e3f-41c2-9e27-381944066f1f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:20.377353 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6d993d5a-5dbc-4ec8-af07-816a2f588260 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:20.386124 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6d993d5a-5dbc-4ec8-af07-816a2f588260 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1510 microversion: 2.1 time: 0.591738 Jul 15 15:29:20.387453 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 158/315] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:19 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1510 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:29:20.448014 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b95cc112-8e3f-41c2-9e27-381944066f1f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:20.457176 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-b95cc112-8e3f-41c2-9e27-381944066f1f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1314 microversion: 2.1 time: 0.553619 Jul 15 15:29:20.457780 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 158/316] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:19 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1314 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:29:20.504137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-cac84b1c-664a-4dbd-9ee7-d3ee88ff97df req-16578d8c-5d6a-44cd-814c-fca871197d35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec939be3-680a-4803-83fd-09f1fbb84e77", "tag": "b6578fcf-4024-4692-ae32-2f7fac84434c"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:29:20.515176 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-cac84b1c-664a-4dbd-9ee7-d3ee88ff97df req-16578d8c-5d6a-44cd-814c-fca871197d35 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:20.515599 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-cac84b1c-664a-4dbd-9ee7-d3ee88ff97df req-16578d8c-5d6a-44cd-814c-fca871197d35 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:20.518498 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=100 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:20.534993 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-cac84b1c-664a-4dbd-9ee7-d3ee88ff97df req-16578d8c-5d6a-44cd-814c-fca871197d35 service nova] Creating event network-changed:b6578fcf-4024-4692-ae32-2f7fac84434c for instance ec939be3-680a-4803-83fd-09f1fbb84e77 on hv-cinder-85001 Jul 15 15:29:20.542879 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-cac84b1c-664a-4dbd-9ee7-d3ee88ff97df req-16578d8c-5d6a-44cd-814c-fca871197d35 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043049 Jul 15 15:29:20.543491 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 159/317] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:29:21.408088 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-268ca5a8-e994-411f-a198-4e98a0c846d2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:21.408698 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-268ca5a8-e994-411f-a198-4e98a0c846d2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:21.415962 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-268ca5a8-e994-411f-a198-4e98a0c846d2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:21.416663 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-268ca5a8-e994-411f-a198-4e98a0c846d2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:21.417596 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-268ca5a8-e994-411f-a198-4e98a0c846d2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:21.418021 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-268ca5a8-e994-411f-a198-4e98a0c846d2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:21.477357 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1f8f2123-3395-4457-9cc7-5cd0c57abb6f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:21.478245 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1f8f2123-3395-4457-9cc7-5cd0c57abb6f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:21.485757 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1f8f2123-3395-4457-9cc7-5cd0c57abb6f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:21.486537 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1f8f2123-3395-4457-9cc7-5cd0c57abb6f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:21.487849 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1f8f2123-3395-4457-9cc7-5cd0c57abb6f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:21.488217 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1f8f2123-3395-4457-9cc7-5cd0c57abb6f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:21.657508 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-268ca5a8-e994-411f-a198-4e98a0c846d2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:21.669461 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-268ca5a8-e994-411f-a198-4e98a0c846d2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1510 microversion: 2.1 time: 0.264942 Jul 15 15:29:21.670661 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 159/318] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:21 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1510 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:29:21.694711 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1f8f2123-3395-4457-9cc7-5cd0c57abb6f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:21.702792 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1f8f2123-3395-4457-9cc7-5cd0c57abb6f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1314 microversion: 2.1 time: 0.231607 Jul 15 15:29:21.703389 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 160/319] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:21 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:29:22.690259 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-6c9b54fc-a019-4e8f-8fbd-a2af43057b3b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:22.691164 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-6c9b54fc-a019-4e8f-8fbd-a2af43057b3b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:22.710912 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6c9b54fc-a019-4e8f-8fbd-a2af43057b3b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:22.712102 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6c9b54fc-a019-4e8f-8fbd-a2af43057b3b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:22.713699 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6c9b54fc-a019-4e8f-8fbd-a2af43057b3b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:22.714644 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6c9b54fc-a019-4e8f-8fbd-a2af43057b3b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:22.724773 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d5fe0ccf-44a3-4ada-944e-ac2c3bc91e36 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:22.729255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d5fe0ccf-44a3-4ada-944e-ac2c3bc91e36 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:22.747901 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d5fe0ccf-44a3-4ada-944e-ac2c3bc91e36 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:22.749681 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d5fe0ccf-44a3-4ada-944e-ac2c3bc91e36 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:22.754198 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d5fe0ccf-44a3-4ada-944e-ac2c3bc91e36 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:22.757850 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d5fe0ccf-44a3-4ada-944e-ac2c3bc91e36 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:23.056675 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6c9b54fc-a019-4e8f-8fbd-a2af43057b3b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:23.066205 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-6c9b54fc-a019-4e8f-8fbd-a2af43057b3b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1516 microversion: 2.1 time: 0.379930 Jul 15 15:29:23.067337 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 160/320] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:22 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1516 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:23.089809 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d5fe0ccf-44a3-4ada-944e-ac2c3bc91e36 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:23.104456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d5fe0ccf-44a3-4ada-944e-ac2c3bc91e36 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1314 microversion: 2.1 time: 0.386704 Jul 15 15:29:23.105428 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 161/321] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:22 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:24.127885 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-5b013907-5235-4c30-9dd3-ea3a1de39917 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:24.128659 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-5b013907-5235-4c30-9dd3-ea3a1de39917 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:24.137294 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5b013907-5235-4c30-9dd3-ea3a1de39917 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:24.138043 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5b013907-5235-4c30-9dd3-ea3a1de39917 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:24.139392 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5b013907-5235-4c30-9dd3-ea3a1de39917 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:24.140107 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5b013907-5235-4c30-9dd3-ea3a1de39917 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:24.337584 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-5b013907-5235-4c30-9dd3-ea3a1de39917 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:24.351109 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-5b013907-5235-4c30-9dd3-ea3a1de39917 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1314 microversion: 2.1 time: 0.227786 Jul 15 15:29:24.352270 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 161/322] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:24 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:25.369461 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6ebf781c-9b70-4915-8b67-793bcbc8c623 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:25.370390 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6ebf781c-9b70-4915-8b67-793bcbc8c623 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:25.372858 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=48 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:25.378903 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6ebf781c-9b70-4915-8b67-793bcbc8c623 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:25.379339 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6ebf781c-9b70-4915-8b67-793bcbc8c623 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:25.380115 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6ebf781c-9b70-4915-8b67-793bcbc8c623 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:25.380721 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6ebf781c-9b70-4915-8b67-793bcbc8c623 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:25.545829 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6ebf781c-9b70-4915-8b67-793bcbc8c623 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:25.556319 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6ebf781c-9b70-4915-8b67-793bcbc8c623 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1314 microversion: 2.1 time: 0.191027 Jul 15 15:29:25.556906 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 162/323] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:25 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:25.706505 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-90146d0c-bc20-4f6b-8b32-d7be006c5978 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Action: 'create', calling method: .version_select at 0x7fe3c6a623a0>, body: {"keypair": {"name": "tempest-keypair-1860053320", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdbPIJ8aJgqzaFBIeZcAYhA+dmzODNSc+pazB4Ntihc5ydmJl6IL1LxHv4d7m9zB26oz1+dod9zFgI7uYk9pBxXgVgwSIn5DNYtjOvVR1CUrs+uyp7GxR+OSZdwZaLnPA=="}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:29:25.721275 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-90146d0c-bc20-4f6b-8b32-d7be006c5978 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Getting quotas for project 1e21747a454c4ebebb5d48b5906d5e5c. Resources: {'key_pairs'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:29:25.725568 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-90146d0c-bc20-4f6b-8b32-d7be006c5978 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Getting quotas for user c1a1af21d3f94b70a830b14200619f87 and project 1e21747a454c4ebebb5d48b5906d5e5c. Resources: {'key_pairs'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:29:25.737582 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR oslo.messaging._drivers.impl_rabbit [None req-90146d0c-bc20-4f6b-8b32-d7be006c5978 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [ec96e912-1e7c-450c-80a7-5f919cdd4297] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 15 15:29:26.577541 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5a2a42e0-142c-4a44-9a3e-9ea7089059b3 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:26.578106 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5a2a42e0-142c-4a44-9a3e-9ea7089059b3 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:26.585216 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5a2a42e0-142c-4a44-9a3e-9ea7089059b3 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:26.585649 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5a2a42e0-142c-4a44-9a3e-9ea7089059b3 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:26.586406 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5a2a42e0-142c-4a44-9a3e-9ea7089059b3 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:26.586875 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5a2a42e0-142c-4a44-9a3e-9ea7089059b3 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:26.745676 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO oslo.messaging._drivers.impl_rabbit [None req-90146d0c-bc20-4f6b-8b32-d7be006c5978 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [ec96e912-1e7c-450c-80a7-5f919cdd4297] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 40064. Jul 15 15:29:26.746382 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5a2a42e0-142c-4a44-9a3e-9ea7089059b3 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:26.752690 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:26.763689 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5a2a42e0-142c-4a44-9a3e-9ea7089059b3 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1314 microversion: 2.1 time: 0.189771 Jul 15 15:29:26.767704 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 163/324] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:26 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:29:26.777122 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-90146d0c-bc20-4f6b-8b32-d7be006c5978 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.074412 Jul 15 15:29:26.777741 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 162/325] 10.222.0.40 () {60 vars in 1158 bytes} [Fri Jul 15 15:29:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:29:27.782930 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e8a07b32-85ff-40a6-9692-9ccd9cc4a38b tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:27.783733 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e8a07b32-85ff-40a6-9692-9ccd9cc4a38b tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:27.791349 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e8a07b32-85ff-40a6-9692-9ccd9cc4a38b tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:27.791800 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e8a07b32-85ff-40a6-9692-9ccd9cc4a38b tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:27.792687 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e8a07b32-85ff-40a6-9692-9ccd9cc4a38b tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:27.793213 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e8a07b32-85ff-40a6-9692-9ccd9cc4a38b tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:28.051466 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e8a07b32-85ff-40a6-9692-9ccd9cc4a38b tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:28.059519 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e8a07b32-85ff-40a6-9692-9ccd9cc4a38b tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1314 microversion: 2.1 time: 0.280962 Jul 15 15:29:28.060094 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 164/326] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:27 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:28.519469 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-406392e9-ccd9-41b3-8ca9-010706690a3a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1102988642", "imageRef": "b9770891-ef3b-4f53-a989-3a4db420d5c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ef188e3b-a856-40b3-a6c2-ccce7f5f2933"}], "security_groups": [{"name": "tempest-securitygroup--1479164927"}], "key_name": "tempest-keypair-1860053320", "user_data": "}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:29:28.639742 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.network.neutron [None req-406392e9-ccd9-41b3-8ca9-010706690a3a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] validate_networks() for [('ef188e3b-a856-40b3-a6c2-ccce7f5f2933', None, None, None, None, None)] {{(pid=117999) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:29:29.066752 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-406392e9-ccd9-41b3-8ca9-010706690a3a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Flavor limits 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:29:29.067168 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-406392e9-ccd9-41b3-8ca9-010706690a3a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Image limits 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:29:29.067676 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-406392e9-ccd9-41b3-8ca9-010706690a3a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Flavor pref 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:29:29.068187 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-406392e9-ccd9-41b3-8ca9-010706690a3a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Image pref 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:29:29.068714 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-406392e9-ccd9-41b3-8ca9-010706690a3a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:29:29.086107 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-406392e9-ccd9-41b3-8ca9-010706690a3a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:29.086591 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-406392e9-ccd9-41b3-8ca9-010706690a3a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:29.087418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-406392e9-ccd9-41b3-8ca9-010706690a3a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:29.087611 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-25e99564-db93-4d63-8676-955673a2a1ee tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:29.088334 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-406392e9-ccd9-41b3-8ca9-010706690a3a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:29.088609 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-25e99564-db93-4d63-8676-955673a2a1ee tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:29.100137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-25e99564-db93-4d63-8676-955673a2a1ee tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:29.100137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-25e99564-db93-4d63-8676-955673a2a1ee tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:29.101065 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-25e99564-db93-4d63-8676-955673a2a1ee tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:29.101512 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-25e99564-db93-4d63-8676-955673a2a1ee tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:29.106501 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-406392e9-ccd9-41b3-8ca9-010706690a3a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Getting quotas for project 1e21747a454c4ebebb5d48b5906d5e5c. Resources: {'ram', 'instances', 'cores'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:29:29.111054 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-406392e9-ccd9-41b3-8ca9-010706690a3a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Getting quotas for user c1a1af21d3f94b70a830b14200619f87 and project 1e21747a454c4ebebb5d48b5906d5e5c. Resources: {'ram', 'instances', 'cores'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:29:29.126618 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-406392e9-ccd9-41b3-8ca9-010706690a3a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Going to run 1 instances... {{(pid=117999) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:29:29.132235 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-406392e9-ccd9-41b3-8ca9-010706690a3a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9770891-ef3b-4f53-a989-3a4db420d5c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117999) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:29:29.219192 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-406392e9-ccd9-41b3-8ca9-010706690a3a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.703369 Jul 15 15:29:29.229171 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 163/327] 10.222.0.40 () {60 vars in 1146 bytes} [Fri Jul 15 15:29:28 2022] POST /compute/v2.1/servers => generated 409 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 15:29:29.239743 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-7a2b6ca5-5b44-4e2b-921c-a4da31f73c6d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:29.240819 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-7a2b6ca5-5b44-4e2b-921c-a4da31f73c6d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:29.324610 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-7a2b6ca5-5b44-4e2b-921c-a4da31f73c6d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:29.332321 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-7a2b6ca5-5b44-4e2b-921c-a4da31f73c6d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1246 microversion: 2.1 time: 0.099597 Jul 15 15:29:29.332512 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-25e99564-db93-4d63-8676-955673a2a1ee tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:29.333183 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 164/328] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:29 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1246 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:29.345600 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-25e99564-db93-4d63-8676-955673a2a1ee tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1314 microversion: 2.1 time: 0.262061 Jul 15 15:29:29.346186 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 165/329] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:29 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:29:30.352757 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-e6246d05-6c69-498f-b8b7-91c0642ea27e tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:30.353665 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-e6246d05-6c69-498f-b8b7-91c0642ea27e tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:30.363628 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9d6dc196-5519-4555-91b8-1fc309e7d4b8 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:30.364415 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9d6dc196-5519-4555-91b8-1fc309e7d4b8 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:30.371670 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9d6dc196-5519-4555-91b8-1fc309e7d4b8 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:30.372118 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9d6dc196-5519-4555-91b8-1fc309e7d4b8 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:30.372888 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9d6dc196-5519-4555-91b8-1fc309e7d4b8 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:30.373318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9d6dc196-5519-4555-91b8-1fc309e7d4b8 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:30.473522 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e6246d05-6c69-498f-b8b7-91c0642ea27e tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:30.488328 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-e6246d05-6c69-498f-b8b7-91c0642ea27e tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1246 microversion: 2.1 time: 0.139438 Jul 15 15:29:30.489795 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 165/330] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:30 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1246 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:30.577748 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9d6dc196-5519-4555-91b8-1fc309e7d4b8 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:30.587994 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9d6dc196-5519-4555-91b8-1fc309e7d4b8 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1314 microversion: 2.1 time: 0.228123 Jul 15 15:29:30.588703 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 166/331] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:30 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:29:31.514881 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-d05bb1e0-1c9c-4d16-9cf2-c2d631c2e9fe tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:31.516031 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-d05bb1e0-1c9c-4d16-9cf2-c2d631c2e9fe tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:31.527783 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d05bb1e0-1c9c-4d16-9cf2-c2d631c2e9fe tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:31.528376 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d05bb1e0-1c9c-4d16-9cf2-c2d631c2e9fe tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:31.529266 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d05bb1e0-1c9c-4d16-9cf2-c2d631c2e9fe tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:31.529792 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d05bb1e0-1c9c-4d16-9cf2-c2d631c2e9fe tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:31.602216 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-d05bb1e0-1c9c-4d16-9cf2-c2d631c2e9fe tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:31.605953 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-64ed826b-07d7-4018-86a9-396501c8b36c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:31.606575 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-64ed826b-07d7-4018-86a9-396501c8b36c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:31.613633 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-64ed826b-07d7-4018-86a9-396501c8b36c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:31.614069 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-64ed826b-07d7-4018-86a9-396501c8b36c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:31.615303 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-64ed826b-07d7-4018-86a9-396501c8b36c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:31.615507 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-d05bb1e0-1c9c-4d16-9cf2-c2d631c2e9fe tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1250 microversion: 2.1 time: 0.106649 Jul 15 15:29:31.615684 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-64ed826b-07d7-4018-86a9-396501c8b36c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:31.616272 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 166/332] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:31 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1250 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:31.775204 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-64ed826b-07d7-4018-86a9-396501c8b36c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:31.784093 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-64ed826b-07d7-4018-86a9-396501c8b36c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1314 microversion: 2.1 time: 0.182034 Jul 15 15:29:31.784673 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 167/333] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:31 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:29:32.637072 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-6e9a5072-82c8-499f-80af-d38ddc53db3c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:32.637683 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-6e9a5072-82c8-499f-80af-d38ddc53db3c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:32.643757 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6e9a5072-82c8-499f-80af-d38ddc53db3c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:32.644184 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6e9a5072-82c8-499f-80af-d38ddc53db3c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:32.644922 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6e9a5072-82c8-499f-80af-d38ddc53db3c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:32.645572 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6e9a5072-82c8-499f-80af-d38ddc53db3c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:32.661927 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:32.717045 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6e9a5072-82c8-499f-80af-d38ddc53db3c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:32.724964 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-6e9a5072-82c8-499f-80af-d38ddc53db3c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1250 microversion: 2.1 time: 0.092128 Jul 15 15:29:32.725650 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 167/334] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:32 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1250 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:32.809382 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-467e1ffb-162b-4aaa-8b61-168a33371bd8 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:32.810082 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-467e1ffb-162b-4aaa-8b61-168a33371bd8 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:32.817325 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-467e1ffb-162b-4aaa-8b61-168a33371bd8 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:32.817912 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-467e1ffb-162b-4aaa-8b61-168a33371bd8 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:32.818831 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-467e1ffb-162b-4aaa-8b61-168a33371bd8 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:32.819474 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-467e1ffb-162b-4aaa-8b61-168a33371bd8 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:32.987074 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-467e1ffb-162b-4aaa-8b61-168a33371bd8 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:32.996353 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-467e1ffb-162b-4aaa-8b61-168a33371bd8 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1314 microversion: 2.1 time: 0.191955 Jul 15 15:29:32.996924 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 168/335] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:32 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:33.746871 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3222ee5d-5461-4250-9aec-8c7aee8d3bbb tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:33.748841 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-3222ee5d-5461-4250-9aec-8c7aee8d3bbb tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:33.758553 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3222ee5d-5461-4250-9aec-8c7aee8d3bbb tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:33.759021 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3222ee5d-5461-4250-9aec-8c7aee8d3bbb tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:33.760292 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3222ee5d-5461-4250-9aec-8c7aee8d3bbb tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:33.761328 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3222ee5d-5461-4250-9aec-8c7aee8d3bbb tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:33.872693 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3222ee5d-5461-4250-9aec-8c7aee8d3bbb tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:33.885600 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-3222ee5d-5461-4250-9aec-8c7aee8d3bbb tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1298 microversion: 2.1 time: 0.145205 Jul 15 15:29:33.896172 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 168/336] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:33 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1298 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:34.018178 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-da1879e7-3b46-4383-b417-140b2db2e4e8 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:34.019131 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-da1879e7-3b46-4383-b417-140b2db2e4e8 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:34.026405 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-da1879e7-3b46-4383-b417-140b2db2e4e8 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:34.027335 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-da1879e7-3b46-4383-b417-140b2db2e4e8 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:34.027698 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-da1879e7-3b46-4383-b417-140b2db2e4e8 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:34.028305 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-da1879e7-3b46-4383-b417-140b2db2e4e8 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:34.168026 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-da1879e7-3b46-4383-b417-140b2db2e4e8 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:34.176022 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-da1879e7-3b46-4383-b417-140b2db2e4e8 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1314 microversion: 2.1 time: 0.164909 Jul 15 15:29:34.176985 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 169/337] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:34 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:34.908134 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-c1045905-08db-40f5-8856-7dcbead796ed tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:34.909117 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-c1045905-08db-40f5-8856-7dcbead796ed tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:34.916862 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c1045905-08db-40f5-8856-7dcbead796ed tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:34.917305 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c1045905-08db-40f5-8856-7dcbead796ed tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:34.918080 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c1045905-08db-40f5-8856-7dcbead796ed tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:34.918509 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c1045905-08db-40f5-8856-7dcbead796ed tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:34.995552 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-c1045905-08db-40f5-8856-7dcbead796ed tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:35.003498 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-c1045905-08db-40f5-8856-7dcbead796ed tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1306 microversion: 2.1 time: 0.099355 Jul 15 15:29:35.004074 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 169/338] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:34 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1306 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:35.195987 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-aae5e787-1046-4121-87aa-a64968ebcf10 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:35.196831 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-aae5e787-1046-4121-87aa-a64968ebcf10 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:35.205673 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aae5e787-1046-4121-87aa-a64968ebcf10 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:35.206368 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aae5e787-1046-4121-87aa-a64968ebcf10 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:35.207554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aae5e787-1046-4121-87aa-a64968ebcf10 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:35.208634 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aae5e787-1046-4121-87aa-a64968ebcf10 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:35.377694 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-aae5e787-1046-4121-87aa-a64968ebcf10 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:35.386001 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-aae5e787-1046-4121-87aa-a64968ebcf10 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1314 microversion: 2.1 time: 0.195390 Jul 15 15:29:35.386608 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 170/339] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:35 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:36.022157 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-1673ec7e-10e9-4c38-8d66-a64488ada0f5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:36.022780 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-1673ec7e-10e9-4c38-8d66-a64488ada0f5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:36.029063 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1673ec7e-10e9-4c38-8d66-a64488ada0f5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:36.029776 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1673ec7e-10e9-4c38-8d66-a64488ada0f5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:36.030568 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1673ec7e-10e9-4c38-8d66-a64488ada0f5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:36.031005 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1673ec7e-10e9-4c38-8d66-a64488ada0f5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:36.121283 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1673ec7e-10e9-4c38-8d66-a64488ada0f5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:36.132487 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-1673ec7e-10e9-4c38-8d66-a64488ada0f5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1306 microversion: 2.1 time: 0.114197 Jul 15 15:29:36.133353 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 170/340] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:36 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1306 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:36.403606 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e94d5c37-0b1a-4110-ae04-d1f53237b678 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:36.404256 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e94d5c37-0b1a-4110-ae04-d1f53237b678 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:36.411152 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e94d5c37-0b1a-4110-ae04-d1f53237b678 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:36.411644 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e94d5c37-0b1a-4110-ae04-d1f53237b678 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:36.412407 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e94d5c37-0b1a-4110-ae04-d1f53237b678 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:36.412837 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e94d5c37-0b1a-4110-ae04-d1f53237b678 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:36.553797 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e94d5c37-0b1a-4110-ae04-d1f53237b678 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:36.562597 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e94d5c37-0b1a-4110-ae04-d1f53237b678 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1314 microversion: 2.1 time: 0.162793 Jul 15 15:29:36.563180 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 171/341] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:36 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:29:37.152837 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-ba81ae53-08ef-4773-818e-321ab84803c1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:37.153432 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-ba81ae53-08ef-4773-818e-321ab84803c1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:37.160819 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ba81ae53-08ef-4773-818e-321ab84803c1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:37.162063 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ba81ae53-08ef-4773-818e-321ab84803c1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:37.162741 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ba81ae53-08ef-4773-818e-321ab84803c1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:37.163279 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ba81ae53-08ef-4773-818e-321ab84803c1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:37.235967 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-ba81ae53-08ef-4773-818e-321ab84803c1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:37.244183 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-ba81ae53-08ef-4773-818e-321ab84803c1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1306 microversion: 2.1 time: 0.095315 Jul 15 15:29:37.244762 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 171/342] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:37 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1306 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:37.582446 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0a12b9ef-9fa0-4580-8f58-a0d54931a966 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:37.583129 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-0a12b9ef-9fa0-4580-8f58-a0d54931a966 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:37.591211 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0a12b9ef-9fa0-4580-8f58-a0d54931a966 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:37.591619 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0a12b9ef-9fa0-4580-8f58-a0d54931a966 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:37.592368 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0a12b9ef-9fa0-4580-8f58-a0d54931a966 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:37.592810 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0a12b9ef-9fa0-4580-8f58-a0d54931a966 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:37.747279 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0a12b9ef-9fa0-4580-8f58-a0d54931a966 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:37.755628 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-0a12b9ef-9fa0-4580-8f58-a0d54931a966 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1314 microversion: 2.1 time: 0.178663 Jul 15 15:29:37.756247 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 172/343] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:37 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:38.262721 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-f69e4d42-0c88-4934-8840-af6ee5c3ebc0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:38.263629 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-f69e4d42-0c88-4934-8840-af6ee5c3ebc0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:38.270107 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f69e4d42-0c88-4934-8840-af6ee5c3ebc0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:38.271310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f69e4d42-0c88-4934-8840-af6ee5c3ebc0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:38.272107 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f69e4d42-0c88-4934-8840-af6ee5c3ebc0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:38.272536 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f69e4d42-0c88-4934-8840-af6ee5c3ebc0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:38.341565 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f69e4d42-0c88-4934-8840-af6ee5c3ebc0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:38.350795 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-f69e4d42-0c88-4934-8840-af6ee5c3ebc0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1306 microversion: 2.1 time: 0.092493 Jul 15 15:29:38.351376 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 172/344] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:38 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1306 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:38.776630 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e0517368-706c-4a37-8b5f-0420131e4913 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:38.777819 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e0517368-706c-4a37-8b5f-0420131e4913 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:38.785503 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e0517368-706c-4a37-8b5f-0420131e4913 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:38.787032 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e0517368-706c-4a37-8b5f-0420131e4913 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:38.788573 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e0517368-706c-4a37-8b5f-0420131e4913 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:38.789222 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e0517368-706c-4a37-8b5f-0420131e4913 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:38.814691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-b9006948-a38a-40db-87e5-9cab4f04909d req-51e7b139-70d1-4c1d-8fae-54c480a346ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec939be3-680a-4803-83fd-09f1fbb84e77", "name": "network-vif-plugged", "status": "completed", "tag": "b6578fcf-4024-4692-ae32-2f7fac84434c"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:29:38.842415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-b9006948-a38a-40db-87e5-9cab4f04909d req-51e7b139-70d1-4c1d-8fae-54c480a346ad service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:38.859291 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-b9006948-a38a-40db-87e5-9cab4f04909d req-51e7b139-70d1-4c1d-8fae-54c480a346ad service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:38.882478 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-b9006948-a38a-40db-87e5-9cab4f04909d req-51e7b139-70d1-4c1d-8fae-54c480a346ad service nova] Creating event network-vif-plugged:b6578fcf-4024-4692-ae32-2f7fac84434c for instance ec939be3-680a-4803-83fd-09f1fbb84e77 on hv-cinder-85001 Jul 15 15:29:38.888758 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-b9006948-a38a-40db-87e5-9cab4f04909d req-51e7b139-70d1-4c1d-8fae-54c480a346ad service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078307 Jul 15 15:29:38.890466 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 173/345] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:29:39.026202 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e0517368-706c-4a37-8b5f-0420131e4913 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:39.034260 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e0517368-706c-4a37-8b5f-0420131e4913 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1314 microversion: 2.1 time: 0.264373 Jul 15 15:29:39.034851 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 173/346] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:38 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:39.373683 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=2 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:39.381840 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-4879fa96-98d8-43dd-9b67-52d8b331605f tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:39.382853 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-4879fa96-98d8-43dd-9b67-52d8b331605f tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:39.397278 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4879fa96-98d8-43dd-9b67-52d8b331605f tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:39.398167 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4879fa96-98d8-43dd-9b67-52d8b331605f tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:39.399135 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4879fa96-98d8-43dd-9b67-52d8b331605f tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:39.399590 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4879fa96-98d8-43dd-9b67-52d8b331605f tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:39.488351 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-4879fa96-98d8-43dd-9b67-52d8b331605f tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:39.499745 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-4879fa96-98d8-43dd-9b67-52d8b331605f tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1304 microversion: 2.1 time: 0.127488 Jul 15 15:29:39.500634 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 174/347] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:39 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1304 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:40.052357 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-59766019-0f94-4a47-b1d1-1b5f022707ff tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:40.053659 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-59766019-0f94-4a47-b1d1-1b5f022707ff tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:40.063105 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-59766019-0f94-4a47-b1d1-1b5f022707ff tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:40.063836 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-59766019-0f94-4a47-b1d1-1b5f022707ff tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:40.064782 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-59766019-0f94-4a47-b1d1-1b5f022707ff tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:40.065433 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-59766019-0f94-4a47-b1d1-1b5f022707ff tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:40.502436 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-59766019-0f94-4a47-b1d1-1b5f022707ff tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:40.515314 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-59766019-0f94-4a47-b1d1-1b5f022707ff tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1314 microversion: 2.1 time: 0.466827 Jul 15 15:29:40.516131 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 174/348] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:40 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:40.526898 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-1501fa24-0063-4c13-8335-1fcc0d48654b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:40.528436 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-1501fa24-0063-4c13-8335-1fcc0d48654b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:40.532559 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=14 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:40.540512 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1501fa24-0063-4c13-8335-1fcc0d48654b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:40.541258 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1501fa24-0063-4c13-8335-1fcc0d48654b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:40.542627 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1501fa24-0063-4c13-8335-1fcc0d48654b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:40.543343 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1501fa24-0063-4c13-8335-1fcc0d48654b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:40.762491 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1501fa24-0063-4c13-8335-1fcc0d48654b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:40.770772 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-1501fa24-0063-4c13-8335-1fcc0d48654b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1372 microversion: 2.1 time: 0.250761 Jul 15 15:29:40.772049 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 175/349] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:40 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1372 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:41.044831 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-ea428d11-898a-4c3e-9e78-e63ac9d5dfd0 req-f2e28644-c469-4499-a7d8-7d5cbd28ca4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eead4bb-c878-4229-b3fc-85f35ec8c5f8", "tag": "680a99e9-4626-4827-a330-033935ba1c3c"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:29:41.054364 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-ea428d11-898a-4c3e-9e78-e63ac9d5dfd0 req-f2e28644-c469-4499-a7d8-7d5cbd28ca4a service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:41.055444 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-ea428d11-898a-4c3e-9e78-e63ac9d5dfd0 req-f2e28644-c469-4499-a7d8-7d5cbd28ca4a service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:41.074464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-ea428d11-898a-4c3e-9e78-e63ac9d5dfd0 req-f2e28644-c469-4499-a7d8-7d5cbd28ca4a service nova] Creating event network-changed:680a99e9-4626-4827-a330-033935ba1c3c for instance 5eead4bb-c878-4229-b3fc-85f35ec8c5f8 on hv-cinder-85001 Jul 15 15:29:41.079711 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-ea428d11-898a-4c3e-9e78-e63ac9d5dfd0 req-f2e28644-c469-4499-a7d8-7d5cbd28ca4a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039688 Jul 15 15:29:41.080610 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 175/350] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:29:41.535427 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-8e80ddb7-d87b-4b8f-b4c4-4bea052c51de tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:41.536060 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-8e80ddb7-d87b-4b8f-b4c4-4bea052c51de tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:41.543042 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8e80ddb7-d87b-4b8f-b4c4-4bea052c51de tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:41.543624 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8e80ddb7-d87b-4b8f-b4c4-4bea052c51de tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:41.544663 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8e80ddb7-d87b-4b8f-b4c4-4bea052c51de tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:41.545435 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8e80ddb7-d87b-4b8f-b4c4-4bea052c51de tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:41.696927 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-8e80ddb7-d87b-4b8f-b4c4-4bea052c51de tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:41.704661 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-8e80ddb7-d87b-4b8f-b4c4-4bea052c51de tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1314 microversion: 2.1 time: 0.173229 Jul 15 15:29:41.705222 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 176/351] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:41 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:41.792505 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f2b9b517-9277-423f-9264-fcc79f15b40b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:41.793371 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f2b9b517-9277-423f-9264-fcc79f15b40b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:41.803150 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f2b9b517-9277-423f-9264-fcc79f15b40b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:41.803773 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f2b9b517-9277-423f-9264-fcc79f15b40b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:41.804913 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f2b9b517-9277-423f-9264-fcc79f15b40b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:41.805583 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f2b9b517-9277-423f-9264-fcc79f15b40b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:41.980910 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f2b9b517-9277-423f-9264-fcc79f15b40b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:41.988603 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f2b9b517-9277-423f-9264-fcc79f15b40b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1372 microversion: 2.1 time: 0.203122 Jul 15 15:29:41.989272 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 176/352] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:41 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1372 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:42.722293 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-4ca47154-59e0-48fe-8faa-f2fb6bf5c608 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:42.723239 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-4ca47154-59e0-48fe-8faa-f2fb6bf5c608 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:42.730338 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4ca47154-59e0-48fe-8faa-f2fb6bf5c608 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:42.730899 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4ca47154-59e0-48fe-8faa-f2fb6bf5c608 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:42.731840 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4ca47154-59e0-48fe-8faa-f2fb6bf5c608 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:42.732256 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4ca47154-59e0-48fe-8faa-f2fb6bf5c608 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:42.872350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-4ca47154-59e0-48fe-8faa-f2fb6bf5c608 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:42.880800 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-4ca47154-59e0-48fe-8faa-f2fb6bf5c608 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1314 microversion: 2.1 time: 0.162411 Jul 15 15:29:42.881382 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 177/353] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:42 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:43.008876 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9bf8adf3-1b94-4d92-ba13-79b2a5955956 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:43.009491 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9bf8adf3-1b94-4d92-ba13-79b2a5955956 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:43.016751 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9bf8adf3-1b94-4d92-ba13-79b2a5955956 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:43.017202 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9bf8adf3-1b94-4d92-ba13-79b2a5955956 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:43.017969 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9bf8adf3-1b94-4d92-ba13-79b2a5955956 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:43.018393 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9bf8adf3-1b94-4d92-ba13-79b2a5955956 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:43.021733 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=100 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:43.175289 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9bf8adf3-1b94-4d92-ba13-79b2a5955956 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:43.184480 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9bf8adf3-1b94-4d92-ba13-79b2a5955956 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1372 microversion: 2.1 time: 0.179787 Jul 15 15:29:43.185053 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 177/354] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:43 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:43.906752 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-ebfea2b4-0a10-4788-b82c-828e5020a4a9 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:43.907631 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-ebfea2b4-0a10-4788-b82c-828e5020a4a9 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:43.913839 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ebfea2b4-0a10-4788-b82c-828e5020a4a9 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:43.914269 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ebfea2b4-0a10-4788-b82c-828e5020a4a9 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:43.915051 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ebfea2b4-0a10-4788-b82c-828e5020a4a9 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:43.915466 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ebfea2b4-0a10-4788-b82c-828e5020a4a9 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:44.071034 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-ebfea2b4-0a10-4788-b82c-828e5020a4a9 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:44.079441 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-ebfea2b4-0a10-4788-b82c-828e5020a4a9 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1314 microversion: 2.1 time: 0.176664 Jul 15 15:29:44.080312 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 178/355] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:43 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:44.205240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-abbcd811-8dda-44fb-822a-69aabb9ffec0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:44.206021 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-abbcd811-8dda-44fb-822a-69aabb9ffec0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:44.213564 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-abbcd811-8dda-44fb-822a-69aabb9ffec0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:44.214009 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-abbcd811-8dda-44fb-822a-69aabb9ffec0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:44.214813 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-abbcd811-8dda-44fb-822a-69aabb9ffec0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:44.215260 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-abbcd811-8dda-44fb-822a-69aabb9ffec0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:44.417109 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-abbcd811-8dda-44fb-822a-69aabb9ffec0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:44.425794 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-abbcd811-8dda-44fb-822a-69aabb9ffec0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1372 microversion: 2.1 time: 0.225482 Jul 15 15:29:44.431516 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 178/356] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:44 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1372 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:29:45.103847 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-ab47f56b-f448-4b01-956a-4898be7c3b4f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:45.104904 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-ab47f56b-f448-4b01-956a-4898be7c3b4f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:45.114150 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ab47f56b-f448-4b01-956a-4898be7c3b4f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:45.114678 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ab47f56b-f448-4b01-956a-4898be7c3b4f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:45.115468 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ab47f56b-f448-4b01-956a-4898be7c3b4f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:45.115891 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ab47f56b-f448-4b01-956a-4898be7c3b4f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:45.297202 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-ab47f56b-f448-4b01-956a-4898be7c3b4f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:45.307850 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-ab47f56b-f448-4b01-956a-4898be7c3b4f tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1314 microversion: 2.1 time: 0.210070 Jul 15 15:29:45.308440 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 179/357] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:45 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:29:45.450193 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ea38ae9d-5834-4fee-b9b0-c006d07f78ee tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:45.451122 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ea38ae9d-5834-4fee-b9b0-c006d07f78ee tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:45.462687 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ea38ae9d-5834-4fee-b9b0-c006d07f78ee tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:45.463407 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ea38ae9d-5834-4fee-b9b0-c006d07f78ee tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:45.464641 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ea38ae9d-5834-4fee-b9b0-c006d07f78ee tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:45.465225 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ea38ae9d-5834-4fee-b9b0-c006d07f78ee tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:45.630869 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ea38ae9d-5834-4fee-b9b0-c006d07f78ee tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:45.639034 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ea38ae9d-5834-4fee-b9b0-c006d07f78ee tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1372 microversion: 2.1 time: 0.195351 Jul 15 15:29:45.639610 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 179/358] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:45 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1372 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:46.325598 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-5edbd84e-d741-4dc7-86fa-da4e0b7e2ea1 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:46.326224 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-5edbd84e-d741-4dc7-86fa-da4e0b7e2ea1 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:46.335079 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5edbd84e-d741-4dc7-86fa-da4e0b7e2ea1 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:46.335832 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5edbd84e-d741-4dc7-86fa-da4e0b7e2ea1 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:46.337049 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5edbd84e-d741-4dc7-86fa-da4e0b7e2ea1 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:46.337487 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5edbd84e-d741-4dc7-86fa-da4e0b7e2ea1 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:46.499820 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-5edbd84e-d741-4dc7-86fa-da4e0b7e2ea1 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:46.513874 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-5edbd84e-d741-4dc7-86fa-da4e0b7e2ea1 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1314 microversion: 2.1 time: 0.191735 Jul 15 15:29:46.514936 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 180/359] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:46 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:46.660397 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-89d7df80-a71e-4f33-99b8-238a2bb04801 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:46.661555 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-89d7df80-a71e-4f33-99b8-238a2bb04801 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:46.672251 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-89d7df80-a71e-4f33-99b8-238a2bb04801 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:46.672979 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-89d7df80-a71e-4f33-99b8-238a2bb04801 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:46.674250 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-89d7df80-a71e-4f33-99b8-238a2bb04801 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:46.675033 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-89d7df80-a71e-4f33-99b8-238a2bb04801 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:46.855434 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-89d7df80-a71e-4f33-99b8-238a2bb04801 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:46.864922 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-89d7df80-a71e-4f33-99b8-238a2bb04801 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1372 microversion: 2.1 time: 0.211844 Jul 15 15:29:46.865781 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 180/360] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:46 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1372 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:47.539458 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-c24611dd-c8cb-4973-8bac-c4ca48bd3dee tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:47.540026 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-c24611dd-c8cb-4973-8bac-c4ca48bd3dee tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:47.546637 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c24611dd-c8cb-4973-8bac-c4ca48bd3dee tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:47.547082 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c24611dd-c8cb-4973-8bac-c4ca48bd3dee tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:47.547849 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c24611dd-c8cb-4973-8bac-c4ca48bd3dee tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:47.548273 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c24611dd-c8cb-4973-8bac-c4ca48bd3dee tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:47.704118 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-c24611dd-c8cb-4973-8bac-c4ca48bd3dee tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:47.708391 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-c24611dd-c8cb-4973-8bac-c4ca48bd3dee tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1314 microversion: 2.1 time: 0.173304 Jul 15 15:29:47.708977 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 181/361] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:47 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:47.888088 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-902da922-9f1f-42a3-ac5c-4b8d76a03b19 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:47.889161 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-902da922-9f1f-42a3-ac5c-4b8d76a03b19 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:47.898704 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-902da922-9f1f-42a3-ac5c-4b8d76a03b19 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:47.899542 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-902da922-9f1f-42a3-ac5c-4b8d76a03b19 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:47.900817 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-902da922-9f1f-42a3-ac5c-4b8d76a03b19 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:47.901513 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-902da922-9f1f-42a3-ac5c-4b8d76a03b19 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:48.058000 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-902da922-9f1f-42a3-ac5c-4b8d76a03b19 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:48.070688 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-902da922-9f1f-42a3-ac5c-4b8d76a03b19 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1372 microversion: 2.1 time: 0.189683 Jul 15 15:29:48.071282 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 181/362] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:47 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1372 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:48.729022 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-c7eda44d-c696-4a91-9e92-882ca3617f74 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:48.730058 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-c7eda44d-c696-4a91-9e92-882ca3617f74 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:48.739587 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c7eda44d-c696-4a91-9e92-882ca3617f74 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:48.740249 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c7eda44d-c696-4a91-9e92-882ca3617f74 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:48.741292 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c7eda44d-c696-4a91-9e92-882ca3617f74 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:48.741774 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c7eda44d-c696-4a91-9e92-882ca3617f74 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:48.896761 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-c7eda44d-c696-4a91-9e92-882ca3617f74 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:48.909508 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-c7eda44d-c696-4a91-9e92-882ca3617f74 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1314 microversion: 2.1 time: 0.186975 Jul 15 15:29:48.910690 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 182/363] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:48 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:49.030630 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 15:29:49.031477 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Fri Jul 15 15:29:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 15:29:49.091910 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6833eb7f-b45a-487f-b01d-f1c5cb213ea1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:49.092928 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6833eb7f-b45a-487f-b01d-f1c5cb213ea1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:49.107438 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6833eb7f-b45a-487f-b01d-f1c5cb213ea1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:49.108178 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6833eb7f-b45a-487f-b01d-f1c5cb213ea1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:49.109485 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6833eb7f-b45a-487f-b01d-f1c5cb213ea1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:49.110254 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6833eb7f-b45a-487f-b01d-f1c5cb213ea1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:49.307354 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6833eb7f-b45a-487f-b01d-f1c5cb213ea1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:49.320046 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6833eb7f-b45a-487f-b01d-f1c5cb213ea1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1372 microversion: 2.1 time: 0.234759 Jul 15 15:29:49.320713 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 182/364] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:49 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1372 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:49.723507 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 15:29:49.724018 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Fri Jul 15 15:29:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 15:29:49.928153 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-cda9bb21-d2cc-4324-a04a-febe588f09e0 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:49.929005 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-cda9bb21-d2cc-4324-a04a-febe588f09e0 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:49.935367 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cda9bb21-d2cc-4324-a04a-febe588f09e0 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:49.935829 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cda9bb21-d2cc-4324-a04a-febe588f09e0 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:49.936563 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cda9bb21-d2cc-4324-a04a-febe588f09e0 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:49.937423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cda9bb21-d2cc-4324-a04a-febe588f09e0 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:50.129942 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-cda9bb21-d2cc-4324-a04a-febe588f09e0 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:50.140347 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-cda9bb21-d2cc-4324-a04a-febe588f09e0 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1314 microversion: 2.1 time: 0.216090 Jul 15 15:29:50.150200 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 183/365] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:49 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:50.337431 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ed43ab59-d98d-42df-84d5-624ea7d5386d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:50.338286 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ed43ab59-d98d-42df-84d5-624ea7d5386d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:50.345745 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ed43ab59-d98d-42df-84d5-624ea7d5386d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:50.346189 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ed43ab59-d98d-42df-84d5-624ea7d5386d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:50.347136 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ed43ab59-d98d-42df-84d5-624ea7d5386d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:50.347575 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ed43ab59-d98d-42df-84d5-624ea7d5386d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:50.636775 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ed43ab59-d98d-42df-84d5-624ea7d5386d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:50.649627 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ed43ab59-d98d-42df-84d5-624ea7d5386d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1372 microversion: 2.1 time: 0.316103 Jul 15 15:29:50.651303 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 183/366] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:50 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1372 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:51.159411 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-126ccd7c-1a5e-421d-b634-c3dde9c6ae05 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:51.160737 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-126ccd7c-1a5e-421d-b634-c3dde9c6ae05 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:51.169373 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-126ccd7c-1a5e-421d-b634-c3dde9c6ae05 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:51.170171 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-126ccd7c-1a5e-421d-b634-c3dde9c6ae05 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:51.171556 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-126ccd7c-1a5e-421d-b634-c3dde9c6ae05 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:51.172139 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-126ccd7c-1a5e-421d-b634-c3dde9c6ae05 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:51.381860 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-126ccd7c-1a5e-421d-b634-c3dde9c6ae05 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:51.384090 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=100 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:51.391064 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-126ccd7c-1a5e-421d-b634-c3dde9c6ae05 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1314 microversion: 2.1 time: 0.237215 Jul 15 15:29:51.391652 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 184/367] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:51 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:51.671160 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-af1cbcb3-3abf-4529-9122-889b935c6e47 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:51.672181 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-af1cbcb3-3abf-4529-9122-889b935c6e47 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:51.685806 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-af1cbcb3-3abf-4529-9122-889b935c6e47 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:51.685806 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-af1cbcb3-3abf-4529-9122-889b935c6e47 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:51.685806 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-af1cbcb3-3abf-4529-9122-889b935c6e47 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:51.685806 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-af1cbcb3-3abf-4529-9122-889b935c6e47 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:51.859068 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-af1cbcb3-3abf-4529-9122-889b935c6e47 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:51.871316 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-af1cbcb3-3abf-4529-9122-889b935c6e47 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1372 microversion: 2.1 time: 0.206388 Jul 15 15:29:51.872228 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 184/368] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:51 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1372 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:52.418183 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-e72e0538-6321-4d61-985e-b9b7e678c62d tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:52.419311 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-e72e0538-6321-4d61-985e-b9b7e678c62d tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:52.436432 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e72e0538-6321-4d61-985e-b9b7e678c62d tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:52.437180 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e72e0538-6321-4d61-985e-b9b7e678c62d tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:52.438437 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e72e0538-6321-4d61-985e-b9b7e678c62d tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:52.439191 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e72e0538-6321-4d61-985e-b9b7e678c62d tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:52.660453 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e72e0538-6321-4d61-985e-b9b7e678c62d tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:52.668251 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-e72e0538-6321-4d61-985e-b9b7e678c62d tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1497 microversion: 2.1 time: 0.257432 Jul 15 15:29:52.668827 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 185/369] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:52 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1497 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:52.899149 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-72ee3b86-ebb8-4a37-9435-2786faa86e78 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:52.900170 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-72ee3b86-ebb8-4a37-9435-2786faa86e78 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:52.911107 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-72ee3b86-ebb8-4a37-9435-2786faa86e78 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:52.911868 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-72ee3b86-ebb8-4a37-9435-2786faa86e78 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:52.913435 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-72ee3b86-ebb8-4a37-9435-2786faa86e78 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:52.914185 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-72ee3b86-ebb8-4a37-9435-2786faa86e78 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:53.126164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-72ee3b86-ebb8-4a37-9435-2786faa86e78 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:53.135786 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-72ee3b86-ebb8-4a37-9435-2786faa86e78 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1372 microversion: 2.1 time: 0.245238 Jul 15 15:29:53.136397 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 185/370] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:52 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1372 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:54.157580 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-377a26f5-278d-4dc4-8f85-4ac712e1cb82 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:54.158908 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-377a26f5-278d-4dc4-8f85-4ac712e1cb82 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:54.169105 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-377a26f5-278d-4dc4-8f85-4ac712e1cb82 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:54.169779 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-377a26f5-278d-4dc4-8f85-4ac712e1cb82 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:54.170721 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-377a26f5-278d-4dc4-8f85-4ac712e1cb82 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:54.171280 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-377a26f5-278d-4dc4-8f85-4ac712e1cb82 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:54.356716 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-377a26f5-278d-4dc4-8f85-4ac712e1cb82 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:54.369194 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-377a26f5-278d-4dc4-8f85-4ac712e1cb82 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1372 microversion: 2.1 time: 0.219005 Jul 15 15:29:54.369859 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 186/371] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:54 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1372 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:55.018301 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-14d621cf-c7a4-4791-8d88-992cc0c941bf tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:55.019027 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-14d621cf-c7a4-4791-8d88-992cc0c941bf tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:55.025775 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-14d621cf-c7a4-4791-8d88-992cc0c941bf tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:55.026214 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-14d621cf-c7a4-4791-8d88-992cc0c941bf tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:55.027012 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-14d621cf-c7a4-4791-8d88-992cc0c941bf tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:55.027443 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-14d621cf-c7a4-4791-8d88-992cc0c941bf tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:55.054291 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-14d621cf-c7a4-4791-8d88-992cc0c941bf tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Going to try to terminate instance {{(pid=117998) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 15:29:55.153165 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-14d621cf-c7a4-4791-8d88-992cc0c941bf tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 204 len: 0 microversion: 2.1 time: 0.138515 Jul 15 15:29:55.153925 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 186/372] 10.222.0.40 () {58 vars in 1238 bytes} [Fri Jul 15 15:29:55 2022] DELETE /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:29:55.163887 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-ee78bc32-f7e2-45f9-b18f-c0e62d4603e5 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:55.164681 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-ee78bc32-f7e2-45f9-b18f-c0e62d4603e5 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:55.170600 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ee78bc32-f7e2-45f9-b18f-c0e62d4603e5 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:55.171037 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ee78bc32-f7e2-45f9-b18f-c0e62d4603e5 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:55.171821 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ee78bc32-f7e2-45f9-b18f-c0e62d4603e5 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:55.172242 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ee78bc32-f7e2-45f9-b18f-c0e62d4603e5 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:55.328376 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-ee78bc32-f7e2-45f9-b18f-c0e62d4603e5 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:55.337595 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-ee78bc32-f7e2-45f9-b18f-c0e62d4603e5 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1503 microversion: 2.1 time: 0.178055 Jul 15 15:29:55.338258 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 187/373] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:55 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1503 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:29:55.403240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f6a437e3-f863-4169-a9fe-f57b5bb7b1c0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:55.403240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f6a437e3-f863-4169-a9fe-f57b5bb7b1c0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:55.403240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:55.404434 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f6a437e3-f863-4169-a9fe-f57b5bb7b1c0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:55.405198 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f6a437e3-f863-4169-a9fe-f57b5bb7b1c0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:55.406545 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f6a437e3-f863-4169-a9fe-f57b5bb7b1c0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:55.407317 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f6a437e3-f863-4169-a9fe-f57b5bb7b1c0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:55.595904 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f6a437e3-f863-4169-a9fe-f57b5bb7b1c0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:55.604472 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f6a437e3-f863-4169-a9fe-f57b5bb7b1c0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1372 microversion: 2.1 time: 0.220537 Jul 15 15:29:55.605061 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 187/374] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:55 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1372 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:29:56.367179 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-52b72ba3-20af-4ad8-8bb0-e6d2b0a44ef0 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:56.368199 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-52b72ba3-20af-4ad8-8bb0-e6d2b0a44ef0 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:56.376187 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-52b72ba3-20af-4ad8-8bb0-e6d2b0a44ef0 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:56.376629 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-52b72ba3-20af-4ad8-8bb0-e6d2b0a44ef0 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:56.377974 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-52b72ba3-20af-4ad8-8bb0-e6d2b0a44ef0 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:56.379539 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-52b72ba3-20af-4ad8-8bb0-e6d2b0a44ef0 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:56.552661 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-52b72ba3-20af-4ad8-8bb0-e6d2b0a44ef0 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:56.563074 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-52b72ba3-20af-4ad8-8bb0-e6d2b0a44ef0 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1503 microversion: 2.1 time: 0.203708 Jul 15 15:29:56.563866 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 188/375] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:56 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1503 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:56.625265 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a31f46a6-ddb5-4e37-832b-92d54af706fc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:56.625815 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a31f46a6-ddb5-4e37-832b-92d54af706fc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:56.634093 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a31f46a6-ddb5-4e37-832b-92d54af706fc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:56.634736 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a31f46a6-ddb5-4e37-832b-92d54af706fc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:56.635610 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a31f46a6-ddb5-4e37-832b-92d54af706fc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:56.636135 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a31f46a6-ddb5-4e37-832b-92d54af706fc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:56.808792 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a31f46a6-ddb5-4e37-832b-92d54af706fc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:56.817163 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a31f46a6-ddb5-4e37-832b-92d54af706fc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1372 microversion: 2.1 time: 0.195964 Jul 15 15:29:56.817812 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 188/376] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:56 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1372 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:57.581904 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-7e7ad194-e14c-413e-95b9-c9f7372cfd01 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:57.582498 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-7e7ad194-e14c-413e-95b9-c9f7372cfd01 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:57.584403 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=70 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:57.591711 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7e7ad194-e14c-413e-95b9-c9f7372cfd01 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:57.592182 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7e7ad194-e14c-413e-95b9-c9f7372cfd01 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:57.592961 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7e7ad194-e14c-413e-95b9-c9f7372cfd01 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:57.593387 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7e7ad194-e14c-413e-95b9-c9f7372cfd01 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:57.764771 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-7e7ad194-e14c-413e-95b9-c9f7372cfd01 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:57.772946 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-7e7ad194-e14c-413e-95b9-c9f7372cfd01 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1503 microversion: 2.1 time: 0.195218 Jul 15 15:29:57.773530 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 189/377] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:57 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1503 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:57.845255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-62fbc6b4-a690-4bbe-a252-c4826b4d2559 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:57.846147 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-62fbc6b4-a690-4bbe-a252-c4826b4d2559 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:57.856103 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-62fbc6b4-a690-4bbe-a252-c4826b4d2559 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:57.856815 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-62fbc6b4-a690-4bbe-a252-c4826b4d2559 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:57.858198 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-62fbc6b4-a690-4bbe-a252-c4826b4d2559 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:57.859000 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-62fbc6b4-a690-4bbe-a252-c4826b4d2559 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:58.083054 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-62fbc6b4-a690-4bbe-a252-c4826b4d2559 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:58.093558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-62fbc6b4-a690-4bbe-a252-c4826b4d2559 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1372 microversion: 2.1 time: 0.253874 Jul 15 15:29:58.094165 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 189/378] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:57 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1372 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:29:58.795438 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-7ea92dda-ea8f-48e5-9310-d3545bd53691 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:58.796118 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-7ea92dda-ea8f-48e5-9310-d3545bd53691 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:58.805058 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7ea92dda-ea8f-48e5-9310-d3545bd53691 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:58.805912 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7ea92dda-ea8f-48e5-9310-d3545bd53691 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:58.806979 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7ea92dda-ea8f-48e5-9310-d3545bd53691 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:58.807560 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7ea92dda-ea8f-48e5-9310-d3545bd53691 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:59.046442 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-7ea92dda-ea8f-48e5-9310-d3545bd53691 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:59.059480 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-7ea92dda-ea8f-48e5-9310-d3545bd53691 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1503 microversion: 2.1 time: 0.266913 Jul 15 15:29:59.066681 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 190/379] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:58 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1503 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:59.111479 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-eaa42080-9cf7-4717-911a-97decbe6e610 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:29:59.112455 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-eaa42080-9cf7-4717-911a-97decbe6e610 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:29:59.119743 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-eaa42080-9cf7-4717-911a-97decbe6e610 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:59.120270 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-eaa42080-9cf7-4717-911a-97decbe6e610 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:59.121952 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-eaa42080-9cf7-4717-911a-97decbe6e610 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:59.121952 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-eaa42080-9cf7-4717-911a-97decbe6e610 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:59.335075 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-eaa42080-9cf7-4717-911a-97decbe6e610 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:29:59.363965 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-eaa42080-9cf7-4717-911a-97decbe6e610 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1372 microversion: 2.1 time: 0.255703 Jul 15 15:29:59.365746 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 190/380] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:29:59 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1372 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:29:59.514412 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-f2fd3732-4de7-4b11-9348-6e6d70612021 req-24dd1129-d014-470a-a273-d8e172ac9ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eead4bb-c878-4229-b3fc-85f35ec8c5f8", "name": "network-vif-plugged", "status": "completed", "tag": "680a99e9-4626-4827-a330-033935ba1c3c"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:29:59.529710 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-f2fd3732-4de7-4b11-9348-6e6d70612021 req-24dd1129-d014-470a-a273-d8e172ac9ada service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:29:59.530110 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-f2fd3732-4de7-4b11-9348-6e6d70612021 req-24dd1129-d014-470a-a273-d8e172ac9ada service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:29:59.545567 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-f2fd3732-4de7-4b11-9348-6e6d70612021 req-24dd1129-d014-470a-a273-d8e172ac9ada service nova] Creating event network-vif-plugged:680a99e9-4626-4827-a330-033935ba1c3c for instance 5eead4bb-c878-4229-b3fc-85f35ec8c5f8 on hv-cinder-85001 Jul 15 15:29:59.553302 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-f2fd3732-4de7-4b11-9348-6e6d70612021 req-24dd1129-d014-470a-a273-d8e172ac9ada service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041387 Jul 15 15:29:59.554097 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 191/381] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:30:00.088709 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ffdc24fd-fc4d-415b-ab30-127ffa50ff6c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:00.089790 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ffdc24fd-fc4d-415b-ab30-127ffa50ff6c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:00.101460 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ffdc24fd-fc4d-415b-ab30-127ffa50ff6c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:00.102212 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ffdc24fd-fc4d-415b-ab30-127ffa50ff6c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:00.103645 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ffdc24fd-fc4d-415b-ab30-127ffa50ff6c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:00.104366 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ffdc24fd-fc4d-415b-ab30-127ffa50ff6c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:00.388210 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ffdc24fd-fc4d-415b-ab30-127ffa50ff6c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:30:00.397158 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-6d381410-96bc-4909-9bf6-ea4d4db14391 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:00.401100 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-6d381410-96bc-4909-9bf6-ea4d4db14391 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:00.407162 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ffdc24fd-fc4d-415b-ab30-127ffa50ff6c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1503 microversion: 2.1 time: 0.325296 Jul 15 15:30:00.408252 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 191/382] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:30:00 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1503 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:00.408462 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6d381410-96bc-4909-9bf6-ea4d4db14391 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:00.409462 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6d381410-96bc-4909-9bf6-ea4d4db14391 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:00.410459 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6d381410-96bc-4909-9bf6-ea4d4db14391 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:00.410921 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6d381410-96bc-4909-9bf6-ea4d4db14391 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:00.695259 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6d381410-96bc-4909-9bf6-ea4d4db14391 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:30:00.705927 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-8789c23d-8a94-458c-b71a-596415405394 req-290137eb-c9d0-43bb-be69-56a1c0e7792a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec939be3-680a-4803-83fd-09f1fbb84e77", "name": "network-vif-deleted", "tag": "b6578fcf-4024-4692-ae32-2f7fac84434c"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:30:00.706467 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-6d381410-96bc-4909-9bf6-ea4d4db14391 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1372 microversion: 2.1 time: 0.317919 Jul 15 15:30:00.707378 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 192/383] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:30:00 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1372 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:30:00.714809 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-8789c23d-8a94-458c-b71a-596415405394 req-290137eb-c9d0-43bb-be69-56a1c0e7792a service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:00.715247 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-8789c23d-8a94-458c-b71a-596415405394 req-290137eb-c9d0-43bb-be69-56a1c0e7792a service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:00.718274 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:00.733214 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-8789c23d-8a94-458c-b71a-596415405394 req-290137eb-c9d0-43bb-be69-56a1c0e7792a service nova] Creating event network-vif-deleted:b6578fcf-4024-4692-ae32-2f7fac84434c for instance ec939be3-680a-4803-83fd-09f1fbb84e77 on hv-cinder-85001 Jul 15 15:30:00.742116 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-8789c23d-8a94-458c-b71a-596415405394 req-290137eb-c9d0-43bb-be69-56a1c0e7792a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039513 Jul 15 15:30:00.743415 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 192/384] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:30:01.439597 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-73bab42c-41f3-4dcb-879c-9092e11aa9ed tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:01.440927 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-73bab42c-41f3-4dcb-879c-9092e11aa9ed tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:01.452021 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-73bab42c-41f3-4dcb-879c-9092e11aa9ed tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:01.452826 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-73bab42c-41f3-4dcb-879c-9092e11aa9ed tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:01.454213 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-73bab42c-41f3-4dcb-879c-9092e11aa9ed tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:01.455060 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-73bab42c-41f3-4dcb-879c-9092e11aa9ed tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:01.508987 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-73bab42c-41f3-4dcb-879c-9092e11aa9ed tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:01.509686 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-73bab42c-41f3-4dcb-879c-9092e11aa9ed tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:01.510677 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.objects.instance [None req-73bab42c-41f3-4dcb-879c-9092e11aa9ed tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lazy-loading 'fault' on Instance uuid ec939be3-680a-4803-83fd-09f1fbb84e77 {{(pid=117999) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:30:01.580066 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-73bab42c-41f3-4dcb-879c-9092e11aa9ed tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:30:01.591943 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-73bab42c-41f3-4dcb-879c-9092e11aa9ed tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1304 microversion: 2.1 time: 0.159822 Jul 15 15:30:01.593003 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 193/385] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:30:01 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1304 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:01.746787 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ced0959f-9cd8-46e8-9c25-3e2616215fe6 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:01.748333 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ced0959f-9cd8-46e8-9c25-3e2616215fe6 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:01.784313 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ced0959f-9cd8-46e8-9c25-3e2616215fe6 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:01.785395 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ced0959f-9cd8-46e8-9c25-3e2616215fe6 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:01.787536 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ced0959f-9cd8-46e8-9c25-3e2616215fe6 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:01.788976 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ced0959f-9cd8-46e8-9c25-3e2616215fe6 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:02.014098 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ced0959f-9cd8-46e8-9c25-3e2616215fe6 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:30:02.026963 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ced0959f-9cd8-46e8-9c25-3e2616215fe6 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1372 microversion: 2.1 time: 0.292145 Jul 15 15:30:02.027917 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 193/386] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:30:01 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1372 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:02.616072 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3e204bf3-e041-40c3-88f6-1ac5737c2dad tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:02.616970 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-3e204bf3-e041-40c3-88f6-1ac5737c2dad tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:02.627594 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3e204bf3-e041-40c3-88f6-1ac5737c2dad tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:02.628580 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3e204bf3-e041-40c3-88f6-1ac5737c2dad tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:02.635135 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3e204bf3-e041-40c3-88f6-1ac5737c2dad tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:02.641311 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3e204bf3-e041-40c3-88f6-1ac5737c2dad tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:02.695995 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3e204bf3-e041-40c3-88f6-1ac5737c2dad tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:02.696782 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3e204bf3-e041-40c3-88f6-1ac5737c2dad tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:02.697834 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.objects.instance [None req-3e204bf3-e041-40c3-88f6-1ac5737c2dad tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lazy-loading 'fault' on Instance uuid ec939be3-680a-4803-83fd-09f1fbb84e77 {{(pid=117999) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:30:02.763838 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3e204bf3-e041-40c3-88f6-1ac5737c2dad tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:30:02.776280 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-3e204bf3-e041-40c3-88f6-1ac5737c2dad tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 200 len: 1304 microversion: 2.1 time: 0.166237 Jul 15 15:30:02.777296 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 194/387] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:30:02 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 1304 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:03.055872 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9a40883e-a4c6-4d1d-9575-cb4b44d2d3b1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:03.056972 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9a40883e-a4c6-4d1d-9575-cb4b44d2d3b1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:03.070203 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9a40883e-a4c6-4d1d-9575-cb4b44d2d3b1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:03.071144 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9a40883e-a4c6-4d1d-9575-cb4b44d2d3b1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:03.073705 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9a40883e-a4c6-4d1d-9575-cb4b44d2d3b1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:03.076415 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9a40883e-a4c6-4d1d-9575-cb4b44d2d3b1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:03.289432 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9a40883e-a4c6-4d1d-9575-cb4b44d2d3b1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:30:03.304033 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9a40883e-a4c6-4d1d-9575-cb4b44d2d3b1 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1566 microversion: 2.1 time: 0.255132 Jul 15 15:30:03.304902 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 194/388] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:30:03 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1566 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:03.326287 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-edb7e0c8-14d8-45fc-bac3-2d29e969a60e tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:03.326828 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-edb7e0c8-14d8-45fc-bac3-2d29e969a60e tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:03.334629 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-edb7e0c8-14d8-45fc-bac3-2d29e969a60e tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:03.335097 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-edb7e0c8-14d8-45fc-bac3-2d29e969a60e tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:03.335834 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-edb7e0c8-14d8-45fc-bac3-2d29e969a60e tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:03.336305 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-edb7e0c8-14d8-45fc-bac3-2d29e969a60e tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:03.458060 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-edb7e0c8-14d8-45fc-bac3-2d29e969a60e tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.136852 Jul 15 15:30:03.459387 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 195/389] 10.222.0.40 () {58 vars in 1274 bytes} [Fri Jul 15 15:30:03 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8/os-interface => generated 285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:30:03.798727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a10a8145-53d5-4633-aeeb-d07da3ae715d tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:03.799929 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a10a8145-53d5-4633-aeeb-d07da3ae715d tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: ec939be3-680a-4803-83fd-09f1fbb84e77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:03.813467 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a10a8145-53d5-4633-aeeb-d07da3ae715d tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:03.813925 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a10a8145-53d5-4633-aeeb-d07da3ae715d tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:03.815071 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a10a8145-53d5-4633-aeeb-d07da3ae715d tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:03.815547 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a10a8145-53d5-4633-aeeb-d07da3ae715d tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:03.840135 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-a10a8145-53d5-4633-aeeb-d07da3ae715d tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] HTTP exception thrown: Instance ec939be3-680a-4803-83fd-09f1fbb84e77 could not be found. Jul 15 15:30:03.843516 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a10a8145-53d5-4633-aeeb-d07da3ae715d tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Request method failure captured: Jul 15 15:30:03.843516 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 HTTP/1.1 Jul 15 15:30:03.843516 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:30:03.843516 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:30:03.843516 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:30:03.843516 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 15 15:30:03.843516 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:30:03.843516 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:30:03.843516 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:30:03.843516 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:30:03.843516 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0Ye95-eKU5RRad3S3HKShPYkb7nmzyqVduEPCW3xtGEqGebzVuW6ucS8s7dbPT4Qibv7i6y4WGe2xYEMrMMjoKWE_4WdiIga7gDU_bk_Fi_ToXDKdTYvgR1pbxmJwakecCaSWyvr-0N2mQdsrAo5CvnBWO2-afId_h2KjkRK3Av6c6E Jul 15 15:30:03.843516 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:30:03.843516 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:30:03.843516 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:30:03.843516 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:30:03.843516 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:30:03.843516 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:30:03.843516 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: 7987f63707dc436c837b81c9c7e32888 Jul 15 15:30:03.843516 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-VolumesActionsTest-1846971799 Jul 15 15:30:03.843516 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:30:03.843516 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:30:03.845977 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7987f63707dc436c837b81c9c7e32888"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7987f63707dc436c837b81c9c7e32888", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7987f63707dc436c837b81c9c7e32888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7987f63707dc436c837b81c9c7e32888"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:30:03.845977 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-VolumesActionsTest-1846971799 Jul 15 15:30:03.845977 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 7987f63707dc436c837b81c9c7e32888 Jul 15 15:30:03.845977 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-VolumesActionsTest-1846971799 Jul 15 15:30:03.845977 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-VolumesActionsTest-1846971799-project Jul 15 15:30:03.845977 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:30:03.845977 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:30:03.845977 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: 8b113432fd9d4e4dafc74874a12364a6 Jul 15 15:30:03.845977 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-VolumesActionsTest-1846971799-project Jul 15 15:30:03.845977 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: > Jul 15 15:30:03.845977 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Instance ec939be3-680a-4803-83fd-09f1fbb84e77 could not be found. Jul 15 15:30:03.845977 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'id': 'ec939be3-680a-4803-83fd-09f1fbb84e77'} Jul 15 15:30:03.848802 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:30:03.848802 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:30:03.848802 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:30:03.848802 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:30:03.848802 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:30:03.848802 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:30:03.848802 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:30:03.848802 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:30:03.848802 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:30:03.848802 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:30:03.848802 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec939be3-680a-4803-83fd-09f1fbb84e77 could not be found. Jul 15 15:30:03.848802 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:30:03.848802 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:30:03.848802 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:30:03.848802 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:30:03.848802 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:30:03.848802 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:30:03.848802 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:30:03.848802 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:30:03.848802 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:30:03.853740 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:30:03.853740 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:30:03.853740 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:30:03.853740 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:30:03.853740 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:30:03.853740 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:30:03.853740 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:30:03.853740 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec939be3-680a-4803-83fd-09f1fbb84e77 could not be found. Jul 15 15:30:03.853740 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:30:03.853740 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:30:03.853740 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:30:03.853740 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:30:03.853740 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:30:03.853740 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:30:03.853740 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:30:03.853740 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:30:03.853740 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec939be3-680a-4803-83fd-09f1fbb84e77 could not be found. Jul 15 15:30:03.853740 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:30:03.857149 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a10a8145-53d5-4633-aeeb-d07da3ae715d tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Returning 404 to user: Instance ec939be3-680a-4803-83fd-09f1fbb84e77 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:30:03.857149 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a10a8145-53d5-4633-aeeb-d07da3ae715d tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77" status: 404 len: 111 microversion: 2.1 time: 0.054316 Jul 15 15:30:03.857149 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 195/390] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:30:03 2022] GET /compute/v2.1/servers/ec939be3-680a-4803-83fd-09f1fbb84e77 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:30:04.037655 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-868b3bc8-5b4f-407b-bdf8-964ffde8de0c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-725970673", "imageRef": "b9770891-ef3b-4f53-a989-3a4db420d5c5", "flavorRef": "452", "networks": [{"uuid": "2d94ac5f-d69c-4bd9-bf90-62f0b5439444"}]}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:30:04.123577 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.network.neutron [None req-868b3bc8-5b4f-407b-bdf8-964ffde8de0c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] validate_networks() for [('2d94ac5f-d69c-4bd9-bf90-62f0b5439444', None, None, None, None, None)] {{(pid=117999) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:30:05.000339 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-868b3bc8-5b4f-407b-bdf8-964ffde8de0c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Flavor limits 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:30:05.000882 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-868b3bc8-5b4f-407b-bdf8-964ffde8de0c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Image limits 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:30:05.001445 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-868b3bc8-5b4f-407b-bdf8-964ffde8de0c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Flavor pref 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:30:05.002251 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-868b3bc8-5b4f-407b-bdf8-964ffde8de0c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Image pref 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:30:05.003063 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-868b3bc8-5b4f-407b-bdf8-964ffde8de0c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:30:05.013697 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-868b3bc8-5b4f-407b-bdf8-964ffde8de0c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:05.014594 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-868b3bc8-5b4f-407b-bdf8-964ffde8de0c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:05.015939 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-868b3bc8-5b4f-407b-bdf8-964ffde8de0c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:05.016609 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-868b3bc8-5b4f-407b-bdf8-964ffde8de0c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:05.050625 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-868b3bc8-5b4f-407b-bdf8-964ffde8de0c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Getting quotas for project 7987f63707dc436c837b81c9c7e32888. Resources: {'ram', 'instances', 'cores'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:30:05.058595 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-868b3bc8-5b4f-407b-bdf8-964ffde8de0c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Getting quotas for user 8b113432fd9d4e4dafc74874a12364a6 and project 7987f63707dc436c837b81c9c7e32888. Resources: {'ram', 'instances', 'cores'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:30:05.081369 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-868b3bc8-5b4f-407b-bdf8-964ffde8de0c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Going to run 1 instances... {{(pid=117999) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:30:05.083841 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-868b3bc8-5b4f-407b-bdf8-964ffde8de0c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: 5febfaca-26b5-4695-9ef9-b0d6b13e80b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9770891-ef3b-4f53-a989-3a4db420d5c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117999) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:30:05.154914 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-868b3bc8-5b4f-407b-bdf8-964ffde8de0c tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.124557 Jul 15 15:30:05.155874 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 196/391] 10.222.0.40 () {60 vars in 1146 bytes} [Fri Jul 15 15:30:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 15:30:05.172977 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-937c39be-ed67-4f26-95b8-c9c7de4265ae tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:05.175398 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-937c39be-ed67-4f26-95b8-c9c7de4265ae tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: 5febfaca-26b5-4695-9ef9-b0d6b13e80b7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:05.255087 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-937c39be-ed67-4f26-95b8-c9c7de4265ae tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:30:05.285571 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-937c39be-ed67-4f26-95b8-c9c7de4265ae tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7" status: 200 len: 1213 microversion: 2.1 time: 0.119552 Jul 15 15:30:05.290779 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 196/392] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:30:05 2022] GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7 => generated 1213 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:05.318201 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-a55ed31e-94de-4a32-aff6-381d9868c858 req-25ca5801-b5d9-4f56-9aba-afa44e2512b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eead4bb-c878-4229-b3fc-85f35ec8c5f8", "tag": "680a99e9-4626-4827-a330-033935ba1c3c"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:30:05.330882 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-a55ed31e-94de-4a32-aff6-381d9868c858 req-25ca5801-b5d9-4f56-9aba-afa44e2512b3 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:05.331456 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-a55ed31e-94de-4a32-aff6-381d9868c858 req-25ca5801-b5d9-4f56-9aba-afa44e2512b3 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:05.356501 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-a55ed31e-94de-4a32-aff6-381d9868c858 req-25ca5801-b5d9-4f56-9aba-afa44e2512b3 service nova] Creating event network-changed:680a99e9-4626-4827-a330-033935ba1c3c for instance 5eead4bb-c878-4229-b3fc-85f35ec8c5f8 on hv-cinder-85001 Jul 15 15:30:05.362186 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-a55ed31e-94de-4a32-aff6-381d9868c858 req-25ca5801-b5d9-4f56-9aba-afa44e2512b3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049670 Jul 15 15:30:05.363070 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 197/393] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:30:06.316987 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9ef90abc-d43d-456a-bf7f-a5e4227b7ee0 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:06.317754 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9ef90abc-d43d-456a-bf7f-a5e4227b7ee0 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: 5febfaca-26b5-4695-9ef9-b0d6b13e80b7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:06.328145 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9ef90abc-d43d-456a-bf7f-a5e4227b7ee0 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:06.328688 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9ef90abc-d43d-456a-bf7f-a5e4227b7ee0 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:06.329991 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9ef90abc-d43d-456a-bf7f-a5e4227b7ee0 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:06.330979 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9ef90abc-d43d-456a-bf7f-a5e4227b7ee0 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:06.412966 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9ef90abc-d43d-456a-bf7f-a5e4227b7ee0 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:30:06.425065 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9ef90abc-d43d-456a-bf7f-a5e4227b7ee0 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7" status: 200 len: 1217 microversion: 2.1 time: 0.113052 Jul 15 15:30:06.436174 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 197/394] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:30:06 2022] GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7 => generated 1217 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:07.448259 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-a8879f05-5334-4d1a-ae79-7173eeb1c599 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:07.448833 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-a8879f05-5334-4d1a-ae79-7173eeb1c599 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: 5febfaca-26b5-4695-9ef9-b0d6b13e80b7] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:07.458040 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a8879f05-5334-4d1a-ae79-7173eeb1c599 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:07.458809 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a8879f05-5334-4d1a-ae79-7173eeb1c599 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:07.460108 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a8879f05-5334-4d1a-ae79-7173eeb1c599 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:07.460854 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a8879f05-5334-4d1a-ae79-7173eeb1c599 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:07.649548 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-a8879f05-5334-4d1a-ae79-7173eeb1c599 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:30:07.660036 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-a8879f05-5334-4d1a-ae79-7173eeb1c599 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7" status: 200 len: 1217 microversion: 2.1 time: 0.216032 Jul 15 15:30:07.660675 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 198/395] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:30:07 2022] GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7 => generated 1217 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:08.686768 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-77a74c76-072a-4b12-87ae-0a016875f9da tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:08.688353 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-77a74c76-072a-4b12-87ae-0a016875f9da tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: 5febfaca-26b5-4695-9ef9-b0d6b13e80b7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:08.699311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-77a74c76-072a-4b12-87ae-0a016875f9da tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:08.699927 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-77a74c76-072a-4b12-87ae-0a016875f9da tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:08.700955 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-77a74c76-072a-4b12-87ae-0a016875f9da tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:08.701504 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-77a74c76-072a-4b12-87ae-0a016875f9da tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:08.825595 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-77a74c76-072a-4b12-87ae-0a016875f9da tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:30:08.839619 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-77a74c76-072a-4b12-87ae-0a016875f9da tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7" status: 200 len: 1271 microversion: 2.1 time: 0.156781 Jul 15 15:30:08.840667 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 198/396] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:30:08 2022] GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7 => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:09.869428 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-e92506e3-51fb-4843-87e3-a7e61312413b tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:09.871128 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-e92506e3-51fb-4843-87e3-a7e61312413b tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: 5febfaca-26b5-4695-9ef9-b0d6b13e80b7] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:09.878133 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e92506e3-51fb-4843-87e3-a7e61312413b tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:09.878866 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e92506e3-51fb-4843-87e3-a7e61312413b tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:09.879638 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e92506e3-51fb-4843-87e3-a7e61312413b tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:09.880057 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e92506e3-51fb-4843-87e3-a7e61312413b tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:10.159990 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e92506e3-51fb-4843-87e3-a7e61312413b tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:30:10.170774 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-e92506e3-51fb-4843-87e3-a7e61312413b tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7" status: 200 len: 1313 microversion: 2.1 time: 0.308429 Jul 15 15:30:10.171657 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 199/397] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:30:09 2022] GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7 => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:10.184984 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-cf57252f-09d4-4138-8f4e-e9a8210f3f59 req-f19c04eb-cca0-4573-b20f-01b5d35e4866 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5febfaca-26b5-4695-9ef9-b0d6b13e80b7", "tag": "44ca7c11-2bf0-4398-b474-8aa2b56c1801"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:30:10.201135 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-cf57252f-09d4-4138-8f4e-e9a8210f3f59 req-f19c04eb-cca0-4573-b20f-01b5d35e4866 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:10.201750 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-cf57252f-09d4-4138-8f4e-e9a8210f3f59 req-f19c04eb-cca0-4573-b20f-01b5d35e4866 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:10.220692 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-cf57252f-09d4-4138-8f4e-e9a8210f3f59 req-f19c04eb-cca0-4573-b20f-01b5d35e4866 service nova] Creating event network-changed:44ca7c11-2bf0-4398-b474-8aa2b56c1801 for instance 5febfaca-26b5-4695-9ef9-b0d6b13e80b7 on hv-cinder-85001 Jul 15 15:30:10.226561 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-cf57252f-09d4-4138-8f4e-e9a8210f3f59 req-f19c04eb-cca0-4573-b20f-01b5d35e4866 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046759 Jul 15 15:30:10.227320 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 199/398] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:30:11.201814 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-a27c9e0e-7656-40fb-b2fe-0c61842fba03 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:11.202948 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-a27c9e0e-7656-40fb-b2fe-0c61842fba03 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: 5febfaca-26b5-4695-9ef9-b0d6b13e80b7] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:11.213704 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a27c9e0e-7656-40fb-b2fe-0c61842fba03 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:11.214378 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a27c9e0e-7656-40fb-b2fe-0c61842fba03 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:11.215769 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a27c9e0e-7656-40fb-b2fe-0c61842fba03 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:11.216520 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a27c9e0e-7656-40fb-b2fe-0c61842fba03 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:11.412828 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-a27c9e0e-7656-40fb-b2fe-0c61842fba03 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:30:11.425153 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-a27c9e0e-7656-40fb-b2fe-0c61842fba03 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7" status: 200 len: 1313 microversion: 2.1 time: 0.229660 Jul 15 15:30:11.425877 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 200/399] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:30:11 2022] GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:12.451272 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-368f649d-6866-4d2a-85a0-be450a964437 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:12.451966 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-368f649d-6866-4d2a-85a0-be450a964437 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: 5febfaca-26b5-4695-9ef9-b0d6b13e80b7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:12.459044 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-368f649d-6866-4d2a-85a0-be450a964437 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:12.459506 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-368f649d-6866-4d2a-85a0-be450a964437 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:12.460251 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-368f649d-6866-4d2a-85a0-be450a964437 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:12.460675 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-368f649d-6866-4d2a-85a0-be450a964437 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:12.601544 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-368f649d-6866-4d2a-85a0-be450a964437 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:30:12.609855 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-368f649d-6866-4d2a-85a0-be450a964437 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7" status: 200 len: 1313 microversion: 2.1 time: 0.163761 Jul 15 15:30:12.610442 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 200/400] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:30:12 2022] GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:30:13.643334 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-1affc650-20dd-46a6-b653-e89c72de1061 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:13.644861 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-1affc650-20dd-46a6-b653-e89c72de1061 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: 5febfaca-26b5-4695-9ef9-b0d6b13e80b7] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:13.659374 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1affc650-20dd-46a6-b653-e89c72de1061 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:13.660064 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1affc650-20dd-46a6-b653-e89c72de1061 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:13.661390 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1affc650-20dd-46a6-b653-e89c72de1061 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:13.662127 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1affc650-20dd-46a6-b653-e89c72de1061 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:13.910089 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1affc650-20dd-46a6-b653-e89c72de1061 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:30:13.923104 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-1affc650-20dd-46a6-b653-e89c72de1061 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7" status: 200 len: 1313 microversion: 2.1 time: 0.288479 Jul 15 15:30:13.924589 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 201/401] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:30:13 2022] GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7 => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:14.947995 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-48aece0d-0e9a-4351-ae1c-dc27e9986001 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:14.948808 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-48aece0d-0e9a-4351-ae1c-dc27e9986001 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: 5febfaca-26b5-4695-9ef9-b0d6b13e80b7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:14.956073 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-48aece0d-0e9a-4351-ae1c-dc27e9986001 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:14.956474 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-48aece0d-0e9a-4351-ae1c-dc27e9986001 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:14.957454 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-48aece0d-0e9a-4351-ae1c-dc27e9986001 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:14.958116 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-48aece0d-0e9a-4351-ae1c-dc27e9986001 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:15.135590 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-48aece0d-0e9a-4351-ae1c-dc27e9986001 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:30:15.144830 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-48aece0d-0e9a-4351-ae1c-dc27e9986001 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7" status: 200 len: 1313 microversion: 2.1 time: 0.200865 Jul 15 15:30:15.145428 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 201/402] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:30:14 2022] GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:16.168522 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-d3a03dad-4f81-4adb-ad8c-87dde51f3049 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:16.169141 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-d3a03dad-4f81-4adb-ad8c-87dde51f3049 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: 5febfaca-26b5-4695-9ef9-b0d6b13e80b7] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:16.174011 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=2 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:16.174011 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=6 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:16.178366 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d3a03dad-4f81-4adb-ad8c-87dde51f3049 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:16.178834 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d3a03dad-4f81-4adb-ad8c-87dde51f3049 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:16.179742 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d3a03dad-4f81-4adb-ad8c-87dde51f3049 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:16.180176 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d3a03dad-4f81-4adb-ad8c-87dde51f3049 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:16.354072 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-d3a03dad-4f81-4adb-ad8c-87dde51f3049 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:30:16.365640 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-d3a03dad-4f81-4adb-ad8c-87dde51f3049 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7" status: 200 len: 1313 microversion: 2.1 time: 0.203879 Jul 15 15:30:16.366365 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 202/403] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:30:16 2022] GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:17.389239 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3d463190-8cab-4de3-8e50-1820bf0f381b tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:17.390162 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3d463190-8cab-4de3-8e50-1820bf0f381b tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: 5febfaca-26b5-4695-9ef9-b0d6b13e80b7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:17.393454 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:17.403113 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3d463190-8cab-4de3-8e50-1820bf0f381b tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:17.404039 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3d463190-8cab-4de3-8e50-1820bf0f381b tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:17.405076 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3d463190-8cab-4de3-8e50-1820bf0f381b tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:17.405673 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3d463190-8cab-4de3-8e50-1820bf0f381b tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:17.584514 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3d463190-8cab-4de3-8e50-1820bf0f381b tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:30:17.592678 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3d463190-8cab-4de3-8e50-1820bf0f381b tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7" status: 200 len: 1313 microversion: 2.1 time: 0.209153 Jul 15 15:30:17.593416 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 202/404] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:30:17 2022] GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:18.614234 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-c6a35089-d0f0-496c-8dfd-7c4bab3d0b52 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:18.615155 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-c6a35089-d0f0-496c-8dfd-7c4bab3d0b52 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: 5febfaca-26b5-4695-9ef9-b0d6b13e80b7] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:18.624355 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c6a35089-d0f0-496c-8dfd-7c4bab3d0b52 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:18.625693 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c6a35089-d0f0-496c-8dfd-7c4bab3d0b52 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:18.628034 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c6a35089-d0f0-496c-8dfd-7c4bab3d0b52 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:18.629231 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c6a35089-d0f0-496c-8dfd-7c4bab3d0b52 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:18.659126 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=100 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:19.072046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-c6a35089-d0f0-496c-8dfd-7c4bab3d0b52 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:30:19.087309 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-c6a35089-d0f0-496c-8dfd-7c4bab3d0b52 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7" status: 200 len: 1313 microversion: 2.1 time: 0.477719 Jul 15 15:30:19.088985 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 203/405] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:30:18 2022] GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7 => generated 1313 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:20.115055 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c879862d-7c1f-46be-9162-fde0b76587d6 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:20.117059 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-c879862d-7c1f-46be-9162-fde0b76587d6 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: 5febfaca-26b5-4695-9ef9-b0d6b13e80b7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:20.124839 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c879862d-7c1f-46be-9162-fde0b76587d6 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:20.125581 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c879862d-7c1f-46be-9162-fde0b76587d6 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:20.126508 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c879862d-7c1f-46be-9162-fde0b76587d6 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:20.127120 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c879862d-7c1f-46be-9162-fde0b76587d6 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:20.281033 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c879862d-7c1f-46be-9162-fde0b76587d6 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:30:20.289269 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-c879862d-7c1f-46be-9162-fde0b76587d6 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7" status: 200 len: 1313 microversion: 2.1 time: 0.180432 Jul 15 15:30:20.289843 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 203/406] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:30:20 2022] GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:21.318731 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-0fd3dc69-72d8-47b1-9535-c6e3790e0712 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:21.319592 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-0fd3dc69-72d8-47b1-9535-c6e3790e0712 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: 5febfaca-26b5-4695-9ef9-b0d6b13e80b7] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:21.325897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0fd3dc69-72d8-47b1-9535-c6e3790e0712 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:21.326338 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0fd3dc69-72d8-47b1-9535-c6e3790e0712 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:21.327145 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0fd3dc69-72d8-47b1-9535-c6e3790e0712 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:21.327581 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0fd3dc69-72d8-47b1-9535-c6e3790e0712 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:21.499140 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-0fd3dc69-72d8-47b1-9535-c6e3790e0712 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:30:21.511618 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-0fd3dc69-72d8-47b1-9535-c6e3790e0712 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7" status: 200 len: 1313 microversion: 2.1 time: 0.196715 Jul 15 15:30:21.512799 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 204/407] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:30:21 2022] GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:30:22.011428 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-1f745525-0306-4894-af09-a8a8787f0cfc req-45a44c8d-ab6e-4676-b90a-1393c7c2d03f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5febfaca-26b5-4695-9ef9-b0d6b13e80b7", "name": "network-vif-plugged", "status": "completed", "tag": "44ca7c11-2bf0-4398-b474-8aa2b56c1801"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:30:22.022903 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-1f745525-0306-4894-af09-a8a8787f0cfc req-45a44c8d-ab6e-4676-b90a-1393c7c2d03f service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:22.023869 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-1f745525-0306-4894-af09-a8a8787f0cfc req-45a44c8d-ab6e-4676-b90a-1393c7c2d03f service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:22.039715 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-1f745525-0306-4894-af09-a8a8787f0cfc req-45a44c8d-ab6e-4676-b90a-1393c7c2d03f service nova] Creating event network-vif-plugged:44ca7c11-2bf0-4398-b474-8aa2b56c1801 for instance 5febfaca-26b5-4695-9ef9-b0d6b13e80b7 on hv-cinder-85001 Jul 15 15:30:22.045811 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-1f745525-0306-4894-af09-a8a8787f0cfc req-45a44c8d-ab6e-4676-b90a-1393c7c2d03f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037812 Jul 15 15:30:22.046798 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 204/408] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:30:22.529910 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-05bfac77-ee7d-483f-9b88-ca2b07c3b607 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:22.530728 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-05bfac77-ee7d-483f-9b88-ca2b07c3b607 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: 5febfaca-26b5-4695-9ef9-b0d6b13e80b7] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:22.537643 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-05bfac77-ee7d-483f-9b88-ca2b07c3b607 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:22.538080 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-05bfac77-ee7d-483f-9b88-ca2b07c3b607 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:22.538888 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-05bfac77-ee7d-483f-9b88-ca2b07c3b607 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:22.539314 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-05bfac77-ee7d-483f-9b88-ca2b07c3b607 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:22.701901 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-05bfac77-ee7d-483f-9b88-ca2b07c3b607 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:30:22.710577 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-05bfac77-ee7d-483f-9b88-ca2b07c3b607 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7" status: 200 len: 1313 microversion: 2.1 time: 0.184843 Jul 15 15:30:22.711167 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 205/409] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:30:22 2022] GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:23.734041 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a71dab6b-4203-4fd5-b0a2-a3a8000d5880 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:23.735058 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a71dab6b-4203-4fd5-b0a2-a3a8000d5880 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: 5febfaca-26b5-4695-9ef9-b0d6b13e80b7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:23.742117 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a71dab6b-4203-4fd5-b0a2-a3a8000d5880 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:23.742749 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a71dab6b-4203-4fd5-b0a2-a3a8000d5880 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:23.743569 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a71dab6b-4203-4fd5-b0a2-a3a8000d5880 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:23.744184 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a71dab6b-4203-4fd5-b0a2-a3a8000d5880 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:23.908346 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a71dab6b-4203-4fd5-b0a2-a3a8000d5880 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:30:23.925841 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a71dab6b-4203-4fd5-b0a2-a3a8000d5880 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7" status: 200 len: 1313 microversion: 2.1 time: 0.200353 Jul 15 15:30:23.926553 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 205/410] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:30:23 2022] GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:24.946264 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-e79ea397-e8a8-451e-a5a1-2078daeafed1 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:24.947121 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-e79ea397-e8a8-451e-a5a1-2078daeafed1 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: 5febfaca-26b5-4695-9ef9-b0d6b13e80b7] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:24.953576 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e79ea397-e8a8-451e-a5a1-2078daeafed1 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:24.954015 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e79ea397-e8a8-451e-a5a1-2078daeafed1 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:24.955005 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e79ea397-e8a8-451e-a5a1-2078daeafed1 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:24.955439 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e79ea397-e8a8-451e-a5a1-2078daeafed1 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:25.134564 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e79ea397-e8a8-451e-a5a1-2078daeafed1 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:30:25.146248 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-e79ea397-e8a8-451e-a5a1-2078daeafed1 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7" status: 200 len: 1496 microversion: 2.1 time: 0.204477 Jul 15 15:30:25.147317 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 206/411] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:30:24 2022] GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7 => generated 1496 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:30:25.665791 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-158f4e22-35ef-4c0a-850c-1f16ef4ef409 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:25.666477 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-158f4e22-35ef-4c0a-850c-1f16ef4ef409 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: 5febfaca-26b5-4695-9ef9-b0d6b13e80b7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:25.669793 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=40 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:25.675662 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-158f4e22-35ef-4c0a-850c-1f16ef4ef409 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:25.676105 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-158f4e22-35ef-4c0a-850c-1f16ef4ef409 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:25.676875 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-158f4e22-35ef-4c0a-850c-1f16ef4ef409 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:25.677334 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-158f4e22-35ef-4c0a-850c-1f16ef4ef409 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:25.712146 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-158f4e22-35ef-4c0a-850c-1f16ef4ef409 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: 5febfaca-26b5-4695-9ef9-b0d6b13e80b7] Going to try to terminate instance {{(pid=117998) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 15:30:25.804791 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-158f4e22-35ef-4c0a-850c-1f16ef4ef409 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7" status: 204 len: 0 microversion: 2.1 time: 0.143188 Jul 15 15:30:25.805419 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 206/412] 10.222.0.40 () {58 vars in 1238 bytes} [Fri Jul 15 15:30:25 2022] DELETE /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:25.817800 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-cf589e26-b212-4fea-a3f2-01ac1cad36fd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:25.818503 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-cf589e26-b212-4fea-a3f2-01ac1cad36fd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: 5febfaca-26b5-4695-9ef9-b0d6b13e80b7] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:25.825110 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cf589e26-b212-4fea-a3f2-01ac1cad36fd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:25.825623 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cf589e26-b212-4fea-a3f2-01ac1cad36fd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:25.826446 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cf589e26-b212-4fea-a3f2-01ac1cad36fd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:25.826986 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cf589e26-b212-4fea-a3f2-01ac1cad36fd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:25.979856 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-cf589e26-b212-4fea-a3f2-01ac1cad36fd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:30:25.988371 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-cf589e26-b212-4fea-a3f2-01ac1cad36fd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7" status: 200 len: 1502 microversion: 2.1 time: 0.175914 Jul 15 15:30:25.988944 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 207/413] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:30:25 2022] GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7 => generated 1502 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:27.008827 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-107db7aa-4fb4-456c-8f5a-67ac623f34cd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:27.009529 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-107db7aa-4fb4-456c-8f5a-67ac623f34cd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: 5febfaca-26b5-4695-9ef9-b0d6b13e80b7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:27.016541 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-107db7aa-4fb4-456c-8f5a-67ac623f34cd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:27.017286 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-107db7aa-4fb4-456c-8f5a-67ac623f34cd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:27.018086 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-107db7aa-4fb4-456c-8f5a-67ac623f34cd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:27.018862 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-107db7aa-4fb4-456c-8f5a-67ac623f34cd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:27.169690 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-107db7aa-4fb4-456c-8f5a-67ac623f34cd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:30:27.179642 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-107db7aa-4fb4-456c-8f5a-67ac623f34cd tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7" status: 200 len: 1502 microversion: 2.1 time: 0.177065 Jul 15 15:30:27.180230 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 207/414] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:30:27 2022] GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7 => generated 1502 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:28.210373 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-49b76ec8-8a93-4d27-bc05-59ea8f8b3f97 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:28.211428 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-49b76ec8-8a93-4d27-bc05-59ea8f8b3f97 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: 5febfaca-26b5-4695-9ef9-b0d6b13e80b7] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:28.214338 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:28.222854 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-49b76ec8-8a93-4d27-bc05-59ea8f8b3f97 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:28.223638 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-49b76ec8-8a93-4d27-bc05-59ea8f8b3f97 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:28.225076 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-49b76ec8-8a93-4d27-bc05-59ea8f8b3f97 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:28.225938 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-49b76ec8-8a93-4d27-bc05-59ea8f8b3f97 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:28.469072 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-49b76ec8-8a93-4d27-bc05-59ea8f8b3f97 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b113432fd9d4e4dafc74874a12364a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7987f63707dc436c837b81c9c7e32888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:30:28.482598 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-49b76ec8-8a93-4d27-bc05-59ea8f8b3f97 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7" status: 200 len: 1502 microversion: 2.1 time: 0.277914 Jul 15 15:30:28.483443 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 208/415] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:30:28 2022] GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7 => generated 1502 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:28.542961 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-661e578b-c22f-43c3-93d8-4b05df03b56d req-ff2f15c9-b92c-40ca-a8a3-e93951031ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5febfaca-26b5-4695-9ef9-b0d6b13e80b7", "name": "network-vif-deleted", "tag": "44ca7c11-2bf0-4398-b474-8aa2b56c1801"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:30:28.553063 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-661e578b-c22f-43c3-93d8-4b05df03b56d req-ff2f15c9-b92c-40ca-a8a3-e93951031ab6 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:28.553490 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-661e578b-c22f-43c3-93d8-4b05df03b56d req-ff2f15c9-b92c-40ca-a8a3-e93951031ab6 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:28.566044 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-661e578b-c22f-43c3-93d8-4b05df03b56d req-ff2f15c9-b92c-40ca-a8a3-e93951031ab6 service nova] Creating event network-vif-deleted:44ca7c11-2bf0-4398-b474-8aa2b56c1801 for instance 5febfaca-26b5-4695-9ef9-b0d6b13e80b7 on hv-cinder-85001 Jul 15 15:30:28.572034 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-661e578b-c22f-43c3-93d8-4b05df03b56d req-ff2f15c9-b92c-40ca-a8a3-e93951031ab6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032732 Jul 15 15:30:28.572667 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 208/416] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:30:29.502229 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-0428c035-4cd9-4e75-8b1a-380e1f036933 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:29.502883 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-0428c035-4cd9-4e75-8b1a-380e1f036933 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] [instance: 5febfaca-26b5-4695-9ef9-b0d6b13e80b7] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:29.509672 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0428c035-4cd9-4e75-8b1a-380e1f036933 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:29.510114 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0428c035-4cd9-4e75-8b1a-380e1f036933 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:29.511035 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0428c035-4cd9-4e75-8b1a-380e1f036933 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:29.511488 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0428c035-4cd9-4e75-8b1a-380e1f036933 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:29.526104 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.wsgi [None req-0428c035-4cd9-4e75-8b1a-380e1f036933 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] HTTP exception thrown: Instance 5febfaca-26b5-4695-9ef9-b0d6b13e80b7 could not be found. Jul 15 15:30:29.527859 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-0428c035-4cd9-4e75-8b1a-380e1f036933 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Request method failure captured: Jul 15 15:30:29.527859 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: request: GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7 HTTP/1.1 Jul 15 15:30:29.527859 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept: application/json Jul 15 15:30:29.527859 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept-Encoding: identity Jul 15 15:30:29.527859 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Connection: close Jul 15 15:30:29.527859 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Length: 0 Jul 15 15:30:29.527859 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Type: application/json Jul 15 15:30:29.527859 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Host: 10.222.0.40 Jul 15 15:30:29.527859 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Openstack-System-Scope: None Jul 15 15:30:29.527859 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: User-Agent: python-urllib3/1.26.9 Jul 15 15:30:29.527859 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Auth-Token: gAAAAABi0Ye95-eKU5RRad3S3HKShPYkb7nmzyqVduEPCW3xtGEqGebzVuW6ucS8s7dbPT4Qibv7i6y4WGe2xYEMrMMjoKWE_4WdiIga7gDU_bk_Fi_ToXDKdTYvgR1pbxmJwakecCaSWyvr-0N2mQdsrAo5CvnBWO2-afId_h2KjkRK3Av6c6E Jul 15 15:30:29.527859 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Id: None Jul 15 15:30:29.527859 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Name: None Jul 15 15:30:29.527859 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Identity-Status: Confirmed Jul 15 15:30:29.527859 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Is-Admin-Project: True Jul 15 15:30:29.527859 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Id: default Jul 15 15:30:29.527859 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Name: Default Jul 15 15:30:29.527859 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Id: 7987f63707dc436c837b81c9c7e32888 Jul 15 15:30:29.527859 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Name: tempest-VolumesActionsTest-1846971799 Jul 15 15:30:29.527859 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Role: member,reader Jul 15 15:30:29.527859 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Roles: member,reader Jul 15 15:30:29.530358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7987f63707dc436c837b81c9c7e32888"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7987f63707dc436c837b81c9c7e32888", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7987f63707dc436c837b81c9c7e32888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7987f63707dc436c837b81c9c7e32888"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:30:29.530358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant: tempest-VolumesActionsTest-1846971799 Jul 15 15:30:29.530358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Id: 7987f63707dc436c837b81c9c7e32888 Jul 15 15:30:29.530358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Name: tempest-VolumesActionsTest-1846971799 Jul 15 15:30:29.530358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User: tempest-VolumesActionsTest-1846971799-project Jul 15 15:30:29.530358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Id: default Jul 15 15:30:29.530358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Name: Default Jul 15 15:30:29.530358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Id: 8b113432fd9d4e4dafc74874a12364a6 Jul 15 15:30:29.530358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Name: tempest-VolumesActionsTest-1846971799-project Jul 15 15:30:29.530358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: method: > Jul 15 15:30:29.530358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: exception: Instance 5febfaca-26b5-4695-9ef9-b0d6b13e80b7 could not be found. Jul 15 15:30:29.530358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: action_args: {'id': '5febfaca-26b5-4695-9ef9-b0d6b13e80b7'} Jul 15 15:30:29.531897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:30:29.531897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:30:29.531897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:30:29.531897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:30:29.531897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:30:29.531897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:30:29.531897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:30:29.531897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:30:29.531897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:30:29.531897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:30:29.531897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5febfaca-26b5-4695-9ef9-b0d6b13e80b7 could not be found. Jul 15 15:30:29.531897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:30:29.531897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:30:29.531897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:30:29.531897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:30:29.531897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:30:29.531897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:30:29.531897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:30:29.531897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:30:29.531897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:30:29.534513 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:30:29.534513 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:30:29.534513 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:30:29.534513 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:30:29.534513 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:30:29.534513 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:30:29.534513 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:30:29.534513 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5febfaca-26b5-4695-9ef9-b0d6b13e80b7 could not be found. Jul 15 15:30:29.534513 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:30:29.534513 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:30:29.534513 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:30:29.534513 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:30:29.534513 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:30:29.534513 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:30:29.534513 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:30:29.534513 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:30:29.534513 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5febfaca-26b5-4695-9ef9-b0d6b13e80b7 could not be found. Jul 15 15:30:29.534513 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:30:29.536107 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-0428c035-4cd9-4e75-8b1a-380e1f036933 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] Returning 404 to user: Instance 5febfaca-26b5-4695-9ef9-b0d6b13e80b7 could not be found. {{(pid=117999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:30:29.536107 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-0428c035-4cd9-4e75-8b1a-380e1f036933 tempest-VolumesActionsTest-1846971799 tempest-VolumesActionsTest-1846971799-project] 10.222.0.40 "GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7" status: 404 len: 111 microversion: 2.1 time: 0.031309 Jul 15 15:30:29.536107 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 209/417] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:30:29 2022] GET /compute/v2.1/servers/5febfaca-26b5-4695-9ef9-b0d6b13e80b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:30:59.350040 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:59.350867 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:59.355320 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-71913e04-f284-41a0-b1ac-1fc4919f1527 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-951142673", "imageRef": "b9770891-ef3b-4f53-a989-3a4db420d5c5", "flavorRef": "452", "networks": [{"uuid": "46a06aa9-e236-455a-a5e0-dcd3c94c9bb2"}]}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:30:59.416393 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.network.neutron [None req-71913e04-f284-41a0-b1ac-1fc4919f1527 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] validate_networks() for [('46a06aa9-e236-455a-a5e0-dcd3c94c9bb2', None, None, None, None, None)] {{(pid=117998) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:30:59.813217 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-71913e04-f284-41a0-b1ac-1fc4919f1527 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Flavor limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:30:59.813636 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-71913e04-f284-41a0-b1ac-1fc4919f1527 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Image limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:30:59.814138 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-71913e04-f284-41a0-b1ac-1fc4919f1527 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Flavor pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:30:59.814558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-71913e04-f284-41a0-b1ac-1fc4919f1527 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Image pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:30:59.814970 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-71913e04-f284-41a0-b1ac-1fc4919f1527 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:30:59.828282 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-71913e04-f284-41a0-b1ac-1fc4919f1527 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:59.829050 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-71913e04-f284-41a0-b1ac-1fc4919f1527 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:59.830379 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-71913e04-f284-41a0-b1ac-1fc4919f1527 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:30:59.831157 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-71913e04-f284-41a0-b1ac-1fc4919f1527 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:30:59.857762 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-71913e04-f284-41a0-b1ac-1fc4919f1527 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Getting quotas for project 6fd8c6fef93d4313bb7894175242fd8c. Resources: {'ram', 'instances', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:30:59.864150 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-71913e04-f284-41a0-b1ac-1fc4919f1527 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Getting quotas for user 28669cdf427a4012a766df06d598e54d and project 6fd8c6fef93d4313bb7894175242fd8c. Resources: {'ram', 'instances', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:30:59.878090 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-71913e04-f284-41a0-b1ac-1fc4919f1527 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Going to run 1 instances... {{(pid=117998) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:30:59.881931 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-71913e04-f284-41a0-b1ac-1fc4919f1527 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9770891-ef3b-4f53-a989-3a4db420d5c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117998) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:30:59.934699 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-71913e04-f284-41a0-b1ac-1fc4919f1527 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587698 Jul 15 15:30:59.935729 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 209/418] 10.222.0.40 () {60 vars in 1146 bytes} [Fri Jul 15 15:30:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 15:30:59.950116 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-44ea90ba-ce0e-44ff-bbe5-3d414b6833a1 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:30:59.951189 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-44ea90ba-ce0e-44ff-bbe5-3d414b6833a1 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:30:59.951189 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=3 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:59.951189 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=37 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:00.041143 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-44ea90ba-ce0e-44ff-bbe5-3d414b6833a1 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:00.051004 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-44ea90ba-ce0e-44ff-bbe5-3d414b6833a1 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 200 len: 1218 microversion: 2.1 time: 0.107770 Jul 15 15:31:00.051691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 210/419] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:30:59 2022] GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:01.073371 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-20fad5d4-61d1-44d1-8c16-b485269299b2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:01.074057 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-20fad5d4-61d1-44d1-8c16-b485269299b2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:01.080748 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-20fad5d4-61d1-44d1-8c16-b485269299b2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:01.081177 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-20fad5d4-61d1-44d1-8c16-b485269299b2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:01.082218 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-20fad5d4-61d1-44d1-8c16-b485269299b2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:01.082703 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-20fad5d4-61d1-44d1-8c16-b485269299b2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:01.150089 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-20fad5d4-61d1-44d1-8c16-b485269299b2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:01.158058 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-20fad5d4-61d1-44d1-8c16-b485269299b2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 200 len: 1270 microversion: 2.1 time: 0.090097 Jul 15 15:31:01.158624 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 210/420] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:31:01 2022] GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:02.176276 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-8898e425-b011-41a5-b858-60bda51a3a32 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:02.176875 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-8898e425-b011-41a5-b858-60bda51a3a32 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:02.182886 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8898e425-b011-41a5-b858-60bda51a3a32 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:02.183323 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8898e425-b011-41a5-b858-60bda51a3a32 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:02.184073 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8898e425-b011-41a5-b858-60bda51a3a32 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:02.184493 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8898e425-b011-41a5-b858-60bda51a3a32 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:02.412600 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-8898e425-b011-41a5-b858-60bda51a3a32 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:02.420642 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-8898e425-b011-41a5-b858-60bda51a3a32 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 200 len: 1318 microversion: 2.1 time: 0.248436 Jul 15 15:31:02.421874 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 211/421] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:31:02 2022] GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:02.723821 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-531a3d63-492d-4c26-b851-f9b02780c45f req-d57e72bc-882d-4ccc-9177-2a8f74caabd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fc6933f-611e-4adf-84ec-84e9a7fa7c90", "tag": "58dd8bb7-91bb-4467-80df-f93d4a33ef05"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:31:02.735689 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-531a3d63-492d-4c26-b851-f9b02780c45f req-d57e72bc-882d-4ccc-9177-2a8f74caabd0 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:02.736105 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-531a3d63-492d-4c26-b851-f9b02780c45f req-d57e72bc-882d-4ccc-9177-2a8f74caabd0 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:02.751403 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-531a3d63-492d-4c26-b851-f9b02780c45f req-d57e72bc-882d-4ccc-9177-2a8f74caabd0 service nova] Creating event network-changed:58dd8bb7-91bb-4467-80df-f93d4a33ef05 for instance 0fc6933f-611e-4adf-84ec-84e9a7fa7c90 on hv-cinder-85001 Jul 15 15:31:02.756939 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-531a3d63-492d-4c26-b851-f9b02780c45f req-d57e72bc-882d-4ccc-9177-2a8f74caabd0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038134 Jul 15 15:31:02.757555 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 211/422] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:31:02.783050 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-f2736d71-aec2-4ac0-9916-7f95801fb7d3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:02.783596 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-f2736d71-aec2-4ac0-9916-7f95801fb7d3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:02.789872 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f2736d71-aec2-4ac0-9916-7f95801fb7d3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:02.790312 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f2736d71-aec2-4ac0-9916-7f95801fb7d3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:02.791099 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f2736d71-aec2-4ac0-9916-7f95801fb7d3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:02.791519 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f2736d71-aec2-4ac0-9916-7f95801fb7d3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:02.816699 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-f2736d71-aec2-4ac0-9916-7f95801fb7d3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23/ips" status: 200 len: 146 microversion: 2.1 time: 0.037877 Jul 15 15:31:02.817437 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 212/423] 10.222.0.40 () {58 vars in 1247 bytes} [Fri Jul 15 15:31:02 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:31:03.439863 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-add8645e-bd19-4e2f-a2a0-349b36be6de9 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:03.440643 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-add8645e-bd19-4e2f-a2a0-349b36be6de9 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:03.447115 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-add8645e-bd19-4e2f-a2a0-349b36be6de9 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:03.447542 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-add8645e-bd19-4e2f-a2a0-349b36be6de9 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:03.448288 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-add8645e-bd19-4e2f-a2a0-349b36be6de9 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:03.448697 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-add8645e-bd19-4e2f-a2a0-349b36be6de9 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:03.590484 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-add8645e-bd19-4e2f-a2a0-349b36be6de9 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:03.598287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-add8645e-bd19-4e2f-a2a0-349b36be6de9 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 200 len: 1318 microversion: 2.1 time: 0.163384 Jul 15 15:31:03.598890 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 212/424] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:31:03 2022] GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:04.615596 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-8670b3ed-58ee-436e-9a3c-60c8ebbb1381 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:04.616226 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-8670b3ed-58ee-436e-9a3c-60c8ebbb1381 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:04.624112 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8670b3ed-58ee-436e-9a3c-60c8ebbb1381 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:04.624545 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8670b3ed-58ee-436e-9a3c-60c8ebbb1381 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:04.625318 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8670b3ed-58ee-436e-9a3c-60c8ebbb1381 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:04.625743 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8670b3ed-58ee-436e-9a3c-60c8ebbb1381 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:04.761007 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-8670b3ed-58ee-436e-9a3c-60c8ebbb1381 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:04.769518 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-8670b3ed-58ee-436e-9a3c-60c8ebbb1381 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 200 len: 1318 microversion: 2.1 time: 0.157670 Jul 15 15:31:04.770631 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 213/425] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:31:04 2022] GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:05.791606 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5664a03a-07d6-416d-bbcf-8b7bfb077b0a tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:05.792170 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5664a03a-07d6-416d-bbcf-8b7bfb077b0a tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:05.800556 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5664a03a-07d6-416d-bbcf-8b7bfb077b0a tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:05.801137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5664a03a-07d6-416d-bbcf-8b7bfb077b0a tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:05.801942 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5664a03a-07d6-416d-bbcf-8b7bfb077b0a tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:05.802399 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5664a03a-07d6-416d-bbcf-8b7bfb077b0a tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:05.954906 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5664a03a-07d6-416d-bbcf-8b7bfb077b0a tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:05.966997 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5664a03a-07d6-416d-bbcf-8b7bfb077b0a tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 200 len: 1318 microversion: 2.1 time: 0.180400 Jul 15 15:31:05.967717 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 213/426] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:31:05 2022] GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:06.558038 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-bca4d399-8595-41ff-9d22-e66d225c86ac tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ddb3dbcb-6427-4ff9-8eda-35fe5e0f4f49"}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:31:06.559215 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-bca4d399-8595-41ff-9d22-e66d225c86ac tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:06.566037 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bca4d399-8595-41ff-9d22-e66d225c86ac tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:06.566474 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bca4d399-8595-41ff-9d22-e66d225c86ac tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:06.567268 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bca4d399-8595-41ff-9d22-e66d225c86ac tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:06.567687 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bca4d399-8595-41ff-9d22-e66d225c86ac tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:06.987560 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-75bd5452-d00b-4ad3-8e83-49c91236532c tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:06.988657 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-75bd5452-d00b-4ad3-8e83-49c91236532c tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:06.996214 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-75bd5452-d00b-4ad3-8e83-49c91236532c tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:06.997052 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-75bd5452-d00b-4ad3-8e83-49c91236532c tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:06.997939 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-75bd5452-d00b-4ad3-8e83-49c91236532c tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:06.998467 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-75bd5452-d00b-4ad3-8e83-49c91236532c tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:07.157242 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-75bd5452-d00b-4ad3-8e83-49c91236532c tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:07.165586 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-75bd5452-d00b-4ad3-8e83-49c91236532c tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 200 len: 1318 microversion: 2.1 time: 0.183704 Jul 15 15:31:07.166142 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 214/427] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:31:06 2022] GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:07.521416 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-bca4d399-8595-41ff-9d22-e66d225c86ac tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "POST /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.967917 Jul 15 15:31:07.522171 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 214/428] 10.222.0.40 () {60 vars in 1322 bytes} [Fri Jul 15 15:31:06 2022] POST /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23/os-volume_attachments => generated 194 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:31:08.183325 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6163beb4-f5f9-41bc-a2f7-57c54f140036 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:08.183965 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6163beb4-f5f9-41bc-a2f7-57c54f140036 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:08.191321 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6163beb4-f5f9-41bc-a2f7-57c54f140036 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:08.191764 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6163beb4-f5f9-41bc-a2f7-57c54f140036 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:08.192541 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6163beb4-f5f9-41bc-a2f7-57c54f140036 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:08.192967 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6163beb4-f5f9-41bc-a2f7-57c54f140036 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:08.347989 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6163beb4-f5f9-41bc-a2f7-57c54f140036 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:08.356436 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6163beb4-f5f9-41bc-a2f7-57c54f140036 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 200 len: 1318 microversion: 2.1 time: 0.177017 Jul 15 15:31:08.357461 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 215/429] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:31:08 2022] GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:09.375008 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-22934cc5-6c79-4d7c-ae74-3f0188527950 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:09.375735 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-22934cc5-6c79-4d7c-ae74-3f0188527950 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:09.382722 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-22934cc5-6c79-4d7c-ae74-3f0188527950 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:09.383168 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-22934cc5-6c79-4d7c-ae74-3f0188527950 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:09.383935 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-22934cc5-6c79-4d7c-ae74-3f0188527950 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:09.384373 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-22934cc5-6c79-4d7c-ae74-3f0188527950 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:09.521341 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-22934cc5-6c79-4d7c-ae74-3f0188527950 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:09.529344 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-22934cc5-6c79-4d7c-ae74-3f0188527950 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 200 len: 1318 microversion: 2.1 time: 0.159158 Jul 15 15:31:09.530050 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 215/430] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:31:09 2022] GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:10.147682 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-5d5de77c-bb50-47b9-bc8b-756acfe079e4 req-8aeb9a70-f9ef-4776-bfce-08504502474b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fc6933f-611e-4adf-84ec-84e9a7fa7c90", "name": "network-vif-plugged", "status": "completed", "tag": "58dd8bb7-91bb-4467-80df-f93d4a33ef05"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:31:10.155676 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:10.156880 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=6 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:10.167494 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-5d5de77c-bb50-47b9-bc8b-756acfe079e4 req-8aeb9a70-f9ef-4776-bfce-08504502474b service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:10.167971 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-5d5de77c-bb50-47b9-bc8b-756acfe079e4 req-8aeb9a70-f9ef-4776-bfce-08504502474b service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:10.181550 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-5d5de77c-bb50-47b9-bc8b-756acfe079e4 req-8aeb9a70-f9ef-4776-bfce-08504502474b service nova] Creating event network-vif-plugged:58dd8bb7-91bb-4467-80df-f93d4a33ef05 for instance 0fc6933f-611e-4adf-84ec-84e9a7fa7c90 on hv-cinder-85001 Jul 15 15:31:10.187480 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-5d5de77c-bb50-47b9-bc8b-756acfe079e4 req-8aeb9a70-f9ef-4776-bfce-08504502474b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046515 Jul 15 15:31:10.188108 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 216/431] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:31:10.547133 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-9c67d096-62d2-452f-9962-7998279c5a4b tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:10.547676 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-9c67d096-62d2-452f-9962-7998279c5a4b tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:10.550270 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=2 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:10.555974 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9c67d096-62d2-452f-9962-7998279c5a4b tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:10.556405 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9c67d096-62d2-452f-9962-7998279c5a4b tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:10.557164 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9c67d096-62d2-452f-9962-7998279c5a4b tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:10.557587 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9c67d096-62d2-452f-9962-7998279c5a4b tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:10.703385 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-9c67d096-62d2-452f-9962-7998279c5a4b tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:10.711005 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-9c67d096-62d2-452f-9962-7998279c5a4b tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 200 len: 1318 microversion: 2.1 time: 0.168029 Jul 15 15:31:10.711565 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 216/432] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:31:10 2022] GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:11.729488 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-cc2c7621-4c61-41c4-bdb4-9f9031f2e1ed tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:11.730201 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-cc2c7621-4c61-41c4-bdb4-9f9031f2e1ed tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:11.738776 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cc2c7621-4c61-41c4-bdb4-9f9031f2e1ed tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:11.739242 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cc2c7621-4c61-41c4-bdb4-9f9031f2e1ed tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:11.740073 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cc2c7621-4c61-41c4-bdb4-9f9031f2e1ed tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:11.740523 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cc2c7621-4c61-41c4-bdb4-9f9031f2e1ed tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:11.902552 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-cc2c7621-4c61-41c4-bdb4-9f9031f2e1ed tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:11.913605 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-cc2c7621-4c61-41c4-bdb4-9f9031f2e1ed tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 200 len: 1318 microversion: 2.1 time: 0.188576 Jul 15 15:31:11.914361 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 217/433] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:31:11 2022] GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:12.934136 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-6a0f263a-aab7-4845-b0a0-6a4820f774bd tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:12.934869 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-6a0f263a-aab7-4845-b0a0-6a4820f774bd tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:12.941325 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6a0f263a-aab7-4845-b0a0-6a4820f774bd tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:12.941780 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6a0f263a-aab7-4845-b0a0-6a4820f774bd tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:12.942573 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6a0f263a-aab7-4845-b0a0-6a4820f774bd tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:12.943012 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6a0f263a-aab7-4845-b0a0-6a4820f774bd tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:13.238196 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6a0f263a-aab7-4845-b0a0-6a4820f774bd tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:13.245841 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-6a0f263a-aab7-4845-b0a0-6a4820f774bd tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 200 len: 1507 microversion: 2.1 time: 0.316309 Jul 15 15:31:13.246410 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 217/434] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:31:12 2022] GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 1507 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:15.130183 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-79a8edf8-b90b-4788-ac07-e022f2f86849 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:31:15.139610 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-79a8edf8-b90b-4788-ac07-e022f2f86849 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:15.140377 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-79a8edf8-b90b-4788-ac07-e022f2f86849 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:15.205404 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-79a8edf8-b90b-4788-ac07-e022f2f86849 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Going to try to stop instance {{(pid=117998) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 15 15:31:15.261589 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-79a8edf8-b90b-4788-ac07-e022f2f86849 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "POST /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23/action" status: 202 len: 0 microversion: 2.1 time: 0.134507 Jul 15 15:31:15.262459 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 218/435] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 15 15:31:15 2022] POST /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 15:31:15.272568 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-8ca5d1a9-0d22-4dcf-a2d5-558cdc7ee701 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:15.273728 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-8ca5d1a9-0d22-4dcf-a2d5-558cdc7ee701 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:15.282447 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8ca5d1a9-0d22-4dcf-a2d5-558cdc7ee701 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:15.282812 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8ca5d1a9-0d22-4dcf-a2d5-558cdc7ee701 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:15.283591 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8ca5d1a9-0d22-4dcf-a2d5-558cdc7ee701 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:15.284013 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8ca5d1a9-0d22-4dcf-a2d5-558cdc7ee701 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:15.463721 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-8ca5d1a9-0d22-4dcf-a2d5-558cdc7ee701 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:15.475347 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-8ca5d1a9-0d22-4dcf-a2d5-558cdc7ee701 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1723 microversion: 2.1 time: 0.207244 Jul 15 15:31:15.476125 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 218/436] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:31:15 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:31:16.496700 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e4c48d38-84be-4ad3-8232-dc76fcd5612a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:16.497351 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e4c48d38-84be-4ad3-8232-dc76fcd5612a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:16.504718 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e4c48d38-84be-4ad3-8232-dc76fcd5612a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:16.505154 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e4c48d38-84be-4ad3-8232-dc76fcd5612a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:16.505901 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e4c48d38-84be-4ad3-8232-dc76fcd5612a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:16.506322 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e4c48d38-84be-4ad3-8232-dc76fcd5612a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:16.720235 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e4c48d38-84be-4ad3-8232-dc76fcd5612a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:16.728729 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e4c48d38-84be-4ad3-8232-dc76fcd5612a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1723 microversion: 2.1 time: 0.236938 Jul 15 15:31:16.729295 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 219/437] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:31:16 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:17.748158 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-6bf58d30-5e5f-401f-9151-c87579d302a5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:17.749055 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-6bf58d30-5e5f-401f-9151-c87579d302a5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:17.756690 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6bf58d30-5e5f-401f-9151-c87579d302a5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:17.757168 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6bf58d30-5e5f-401f-9151-c87579d302a5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:17.758002 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6bf58d30-5e5f-401f-9151-c87579d302a5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:17.758432 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6bf58d30-5e5f-401f-9151-c87579d302a5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:17.913649 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6bf58d30-5e5f-401f-9151-c87579d302a5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:17.924575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-6bf58d30-5e5f-401f-9151-c87579d302a5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1723 microversion: 2.1 time: 0.181176 Jul 15 15:31:17.925245 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 219/438] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:31:17 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:18.946730 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-cf338d56-8da4-48bd-8e1c-db9734262a37 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:18.946730 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-cf338d56-8da4-48bd-8e1c-db9734262a37 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:18.955129 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cf338d56-8da4-48bd-8e1c-db9734262a37 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:18.955584 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cf338d56-8da4-48bd-8e1c-db9734262a37 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:18.956398 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cf338d56-8da4-48bd-8e1c-db9734262a37 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:18.956925 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cf338d56-8da4-48bd-8e1c-db9734262a37 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:19.126365 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-cf338d56-8da4-48bd-8e1c-db9734262a37 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:19.136163 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-cf338d56-8da4-48bd-8e1c-db9734262a37 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1723 microversion: 2.1 time: 0.196439 Jul 15 15:31:19.137060 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 220/439] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:31:18 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:19.767423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-fe309698-531f-4552-958f-2c723c2d30d1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:19.768068 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-fe309698-531f-4552-958f-2c723c2d30d1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:19.780477 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fe309698-531f-4552-958f-2c723c2d30d1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:19.780918 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fe309698-531f-4552-958f-2c723c2d30d1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:19.781702 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fe309698-531f-4552-958f-2c723c2d30d1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:19.782126 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fe309698-531f-4552-958f-2c723c2d30d1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:19.809625 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-fe309698-531f-4552-958f-2c723c2d30d1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849/ips" status: 200 len: 153 microversion: 2.20 time: 0.045314 Jul 15 15:31:19.810377 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 220/440] 10.222.0.40 () {60 vars in 1288 bytes} [Fri Jul 15 15:31:19 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849/ips => generated 153 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:31:20.155912 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a2e76ed6-2565-4cc4-8d87-e6006e6ebf42 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:20.156634 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a2e76ed6-2565-4cc4-8d87-e6006e6ebf42 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:20.163258 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a2e76ed6-2565-4cc4-8d87-e6006e6ebf42 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:20.163795 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a2e76ed6-2565-4cc4-8d87-e6006e6ebf42 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:20.164673 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a2e76ed6-2565-4cc4-8d87-e6006e6ebf42 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:20.165347 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a2e76ed6-2565-4cc4-8d87-e6006e6ebf42 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:20.347838 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a2e76ed6-2565-4cc4-8d87-e6006e6ebf42 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:20.360791 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a2e76ed6-2565-4cc4-8d87-e6006e6ebf42 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1723 microversion: 2.1 time: 0.210430 Jul 15 15:31:20.361410 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 221/441] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:31:20 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:21.380427 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-abb906a9-bef8-4ff7-a4eb-a49f726e0af2 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:21.381229 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-abb906a9-bef8-4ff7-a4eb-a49f726e0af2 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:21.388953 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-abb906a9-bef8-4ff7-a4eb-a49f726e0af2 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:21.389389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-abb906a9-bef8-4ff7-a4eb-a49f726e0af2 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:21.390149 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-abb906a9-bef8-4ff7-a4eb-a49f726e0af2 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:21.390591 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-abb906a9-bef8-4ff7-a4eb-a49f726e0af2 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:21.537871 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-abb906a9-bef8-4ff7-a4eb-a49f726e0af2 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:21.547175 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-abb906a9-bef8-4ff7-a4eb-a49f726e0af2 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1723 microversion: 2.1 time: 0.171009 Jul 15 15:31:21.547744 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 221/442] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:31:21 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:22.167516 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-16aced5b-90d6-42dc-bc0d-0293d6d4813a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:31:22.168893 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-16aced5b-90d6-42dc-bc0d-0293d6d4813a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:22.175008 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-16aced5b-90d6-42dc-bc0d-0293d6d4813a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:22.175439 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-16aced5b-90d6-42dc-bc0d-0293d6d4813a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:22.176196 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-16aced5b-90d6-42dc-bc0d-0293d6d4813a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:22.176617 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-16aced5b-90d6-42dc-bc0d-0293d6d4813a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:22.200054 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.objects.instance [None req-16aced5b-90d6-42dc-bc0d-0293d6d4813a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lazy-loading 'flavor' on Instance uuid 5180ff6f-38fa-49c2-9663-9269dcae4849 {{(pid=117998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:31:22.510785 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-16aced5b-90d6-42dc-bc0d-0293d6d4813a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "POST /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849/action" status: 202 len: 0 microversion: 2.20 time: 0.483032 Jul 15 15:31:22.511490 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 222/443] 10.222.0.40 () {62 vars in 1318 bytes} [Fri Jul 15 15:31:22 2022] POST /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:31:22.522782 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-1c3561ba-ef57-468b-8bdc-f7661cdd6192 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:22.523597 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-1c3561ba-ef57-468b-8bdc-f7661cdd6192 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:22.532551 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1c3561ba-ef57-468b-8bdc-f7661cdd6192 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:22.533232 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1c3561ba-ef57-468b-8bdc-f7661cdd6192 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:22.534418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1c3561ba-ef57-468b-8bdc-f7661cdd6192 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:22.535164 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1c3561ba-ef57-468b-8bdc-f7661cdd6192 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:22.569511 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f3514812-4afd-4e39-8ea1-a457bc27f8f5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:22.570805 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f3514812-4afd-4e39-8ea1-a457bc27f8f5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:22.580105 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f3514812-4afd-4e39-8ea1-a457bc27f8f5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:22.580555 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f3514812-4afd-4e39-8ea1-a457bc27f8f5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:22.581468 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f3514812-4afd-4e39-8ea1-a457bc27f8f5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:22.581797 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f3514812-4afd-4e39-8ea1-a457bc27f8f5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:22.764829 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1c3561ba-ef57-468b-8bdc-f7661cdd6192 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:22.775521 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1c3561ba-ef57-468b-8bdc-f7661cdd6192 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:22.778273 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1c3561ba-ef57-468b-8bdc-f7661cdd6192 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:22.779724 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-1c3561ba-ef57-468b-8bdc-f7661cdd6192 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1723 microversion: 2.20 time: 0.262912 Jul 15 15:31:22.780347 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 222/444] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:22 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:31:22.792923 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f3514812-4afd-4e39-8ea1-a457bc27f8f5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:22.803335 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f3514812-4afd-4e39-8ea1-a457bc27f8f5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1723 microversion: 2.1 time: 0.240931 Jul 15 15:31:22.804085 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 223/445] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:31:22 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:23.802540 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-6a9298e7-55b6-4750-acb6-3fdd82f6dec2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:23.803148 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-6a9298e7-55b6-4750-acb6-3fdd82f6dec2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:23.811175 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6a9298e7-55b6-4750-acb6-3fdd82f6dec2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:23.811767 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6a9298e7-55b6-4750-acb6-3fdd82f6dec2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:23.812705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6a9298e7-55b6-4750-acb6-3fdd82f6dec2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:23.813138 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6a9298e7-55b6-4750-acb6-3fdd82f6dec2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:23.823837 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d873f489-990a-4b54-964b-26e149455089 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:23.824563 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d873f489-990a-4b54-964b-26e149455089 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:23.831176 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d873f489-990a-4b54-964b-26e149455089 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:23.831622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d873f489-990a-4b54-964b-26e149455089 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:23.832379 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d873f489-990a-4b54-964b-26e149455089 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:23.832808 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d873f489-990a-4b54-964b-26e149455089 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:23.851099 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:24.035659 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6a9298e7-55b6-4750-acb6-3fdd82f6dec2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:24.040151 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d873f489-990a-4b54-964b-26e149455089 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:24.044725 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6a9298e7-55b6-4750-acb6-3fdd82f6dec2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:24.046229 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6a9298e7-55b6-4750-acb6-3fdd82f6dec2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:24.047414 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-6a9298e7-55b6-4750-acb6-3fdd82f6dec2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1723 microversion: 2.20 time: 0.248857 Jul 15 15:31:24.047975 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 223/446] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:23 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:31:24.048697 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d873f489-990a-4b54-964b-26e149455089 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1723 microversion: 2.1 time: 0.228848 Jul 15 15:31:24.049249 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 224/447] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:31:23 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:31:25.068964 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-7ba6a3e6-c560-4812-8505-ff1e14720b7a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:25.069999 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-7ba6a3e6-c560-4812-8505-ff1e14720b7a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:25.070751 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-493bb710-b3f3-4b12-8bb7-fe41ce9b6d1f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:25.071776 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-493bb710-b3f3-4b12-8bb7-fe41ce9b6d1f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:25.080286 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-493bb710-b3f3-4b12-8bb7-fe41ce9b6d1f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:25.080723 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-493bb710-b3f3-4b12-8bb7-fe41ce9b6d1f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:25.081494 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-493bb710-b3f3-4b12-8bb7-fe41ce9b6d1f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:25.081916 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-493bb710-b3f3-4b12-8bb7-fe41ce9b6d1f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:25.083993 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7ba6a3e6-c560-4812-8505-ff1e14720b7a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:25.084761 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7ba6a3e6-c560-4812-8505-ff1e14720b7a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:25.086079 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7ba6a3e6-c560-4812-8505-ff1e14720b7a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:25.086948 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7ba6a3e6-c560-4812-8505-ff1e14720b7a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:25.303467 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-493bb710-b3f3-4b12-8bb7-fe41ce9b6d1f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:25.315846 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-7ba6a3e6-c560-4812-8505-ff1e14720b7a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:25.317124 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-493bb710-b3f3-4b12-8bb7-fe41ce9b6d1f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:25.318316 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-493bb710-b3f3-4b12-8bb7-fe41ce9b6d1f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:25.319117 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-493bb710-b3f3-4b12-8bb7-fe41ce9b6d1f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1723 microversion: 2.20 time: 0.255159 Jul 15 15:31:25.319981 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 225/448] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:25 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:31:25.329583 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-7ba6a3e6-c560-4812-8505-ff1e14720b7a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1723 microversion: 2.1 time: 0.267476 Jul 15 15:31:25.330582 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 224/449] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:31:25 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:26.343773 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-205f8ec2-fd67-4970-ac5e-e261e27f175d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:26.344454 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-205f8ec2-fd67-4970-ac5e-e261e27f175d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:26.349092 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-26ea9a5d-9d56-4d89-9726-23aa9223fdc4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:26.349814 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-26ea9a5d-9d56-4d89-9726-23aa9223fdc4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:26.351542 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-205f8ec2-fd67-4970-ac5e-e261e27f175d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:26.351985 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-205f8ec2-fd67-4970-ac5e-e261e27f175d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:26.352747 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-205f8ec2-fd67-4970-ac5e-e261e27f175d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:26.353166 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-205f8ec2-fd67-4970-ac5e-e261e27f175d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:26.356958 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-26ea9a5d-9d56-4d89-9726-23aa9223fdc4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:26.357516 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-26ea9a5d-9d56-4d89-9726-23aa9223fdc4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:26.358301 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-26ea9a5d-9d56-4d89-9726-23aa9223fdc4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:26.358765 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-26ea9a5d-9d56-4d89-9726-23aa9223fdc4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:26.573467 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-26ea9a5d-9d56-4d89-9726-23aa9223fdc4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:26.578063 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-205f8ec2-fd67-4970-ac5e-e261e27f175d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:26.582839 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-26ea9a5d-9d56-4d89-9726-23aa9223fdc4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1723 microversion: 2.1 time: 0.238218 Jul 15 15:31:26.583418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 225/450] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:31:26 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:26.587549 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-205f8ec2-fd67-4970-ac5e-e261e27f175d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:26.589188 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-205f8ec2-fd67-4970-ac5e-e261e27f175d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:26.590716 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-205f8ec2-fd67-4970-ac5e-e261e27f175d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1723 microversion: 2.20 time: 0.251188 Jul 15 15:31:26.591656 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 226/451] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:26 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:31:27.601525 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-e8442a7d-ef68-4e7a-851a-42b34b207b35 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:27.602306 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-e8442a7d-ef68-4e7a-851a-42b34b207b35 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:27.609753 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e8442a7d-ef68-4e7a-851a-42b34b207b35 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:27.610325 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e8442a7d-ef68-4e7a-851a-42b34b207b35 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:27.611250 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e8442a7d-ef68-4e7a-851a-42b34b207b35 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:27.611818 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e8442a7d-ef68-4e7a-851a-42b34b207b35 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:27.613388 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-49c05290-7a4d-4d88-9848-900ec4c8145d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:27.614112 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-49c05290-7a4d-4d88-9848-900ec4c8145d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:27.620686 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-49c05290-7a4d-4d88-9848-900ec4c8145d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:27.621644 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-49c05290-7a4d-4d88-9848-900ec4c8145d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:27.622614 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-49c05290-7a4d-4d88-9848-900ec4c8145d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:27.623045 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-49c05290-7a4d-4d88-9848-900ec4c8145d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:27.822074 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e8442a7d-ef68-4e7a-851a-42b34b207b35 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:27.825981 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:27.829915 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-49c05290-7a4d-4d88-9848-900ec4c8145d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:27.833792 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-e8442a7d-ef68-4e7a-851a-42b34b207b35 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1723 microversion: 2.1 time: 0.236016 Jul 15 15:31:27.834540 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 226/452] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:31:27 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:27.838588 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-49c05290-7a4d-4d88-9848-900ec4c8145d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:27.840213 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-49c05290-7a4d-4d88-9848-900ec4c8145d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:27.841300 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-49c05290-7a4d-4d88-9848-900ec4c8145d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1723 microversion: 2.20 time: 0.231737 Jul 15 15:31:27.841755 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 227/453] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:27 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:31:28.858262 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3b6269eb-cb90-46b3-b056-6418249949df tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:28.859291 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-3b6269eb-cb90-46b3-b056-6418249949df tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:28.861370 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-993a975d-3f47-4b54-82ac-80e2202972ae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:28.861989 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-993a975d-3f47-4b54-82ac-80e2202972ae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:28.867502 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3b6269eb-cb90-46b3-b056-6418249949df tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:28.867502 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3b6269eb-cb90-46b3-b056-6418249949df tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:28.868578 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3b6269eb-cb90-46b3-b056-6418249949df tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:28.868881 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-993a975d-3f47-4b54-82ac-80e2202972ae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:28.869002 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3b6269eb-cb90-46b3-b056-6418249949df tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:28.869324 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-993a975d-3f47-4b54-82ac-80e2202972ae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:28.870075 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-993a975d-3f47-4b54-82ac-80e2202972ae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:28.870497 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-993a975d-3f47-4b54-82ac-80e2202972ae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:29.079682 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3b6269eb-cb90-46b3-b056-6418249949df tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:29.090583 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-3b6269eb-cb90-46b3-b056-6418249949df tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1723 microversion: 2.1 time: 0.237233 Jul 15 15:31:29.090842 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-993a975d-3f47-4b54-82ac-80e2202972ae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:29.091159 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 227/454] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:31:28 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:29.100045 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-993a975d-3f47-4b54-82ac-80e2202972ae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:29.101635 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-993a975d-3f47-4b54-82ac-80e2202972ae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:29.103577 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-993a975d-3f47-4b54-82ac-80e2202972ae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1723 microversion: 2.20 time: 0.245638 Jul 15 15:31:29.103577 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 228/455] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:28 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:31:30.123963 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-74ac0698-e1fe-4d10-8ee4-3281c4dde9b7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:30.124777 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-74ac0698-e1fe-4d10-8ee4-3281c4dde9b7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:30.127937 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:30.133904 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-74ac0698-e1fe-4d10-8ee4-3281c4dde9b7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:30.134597 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-74ac0698-e1fe-4d10-8ee4-3281c4dde9b7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:30.135668 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-74ac0698-e1fe-4d10-8ee4-3281c4dde9b7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:30.136198 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-74ac0698-e1fe-4d10-8ee4-3281c4dde9b7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:30.249407 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-05796bf3-0590-4b02-a969-70faf02acc80 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:30.250111 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-05796bf3-0590-4b02-a969-70faf02acc80 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:30.252616 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=39 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:30.260150 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-05796bf3-0590-4b02-a969-70faf02acc80 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:30.260747 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-05796bf3-0590-4b02-a969-70faf02acc80 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:30.262619 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-05796bf3-0590-4b02-a969-70faf02acc80 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:30.263202 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-05796bf3-0590-4b02-a969-70faf02acc80 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:30.325075 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-74ac0698-e1fe-4d10-8ee4-3281c4dde9b7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:30.334177 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-74ac0698-e1fe-4d10-8ee4-3281c4dde9b7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:30.336730 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-74ac0698-e1fe-4d10-8ee4-3281c4dde9b7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:30.338681 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-74ac0698-e1fe-4d10-8ee4-3281c4dde9b7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1723 microversion: 2.20 time: 0.220035 Jul 15 15:31:30.339917 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 229/456] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:30 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:31:30.423433 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-05796bf3-0590-4b02-a969-70faf02acc80 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:30.435336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-05796bf3-0590-4b02-a969-70faf02acc80 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1723 microversion: 2.1 time: 0.330814 Jul 15 15:31:30.436146 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 228/457] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:31:30 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1723 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:31.361544 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9e8099a3-9f91-454e-beda-c2addf3f8463 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:31.362167 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9e8099a3-9f91-454e-beda-c2addf3f8463 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:31.368962 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9e8099a3-9f91-454e-beda-c2addf3f8463 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:31.369402 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9e8099a3-9f91-454e-beda-c2addf3f8463 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:31.370158 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9e8099a3-9f91-454e-beda-c2addf3f8463 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:31.370785 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9e8099a3-9f91-454e-beda-c2addf3f8463 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:31.454069 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-1d31ce19-89fa-47fb-b5fe-d6c37c5d949d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:31.454663 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-1d31ce19-89fa-47fb-b5fe-d6c37c5d949d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:31.461138 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1d31ce19-89fa-47fb-b5fe-d6c37c5d949d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:31.461576 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1d31ce19-89fa-47fb-b5fe-d6c37c5d949d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:31.462342 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1d31ce19-89fa-47fb-b5fe-d6c37c5d949d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:31.462799 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1d31ce19-89fa-47fb-b5fe-d6c37c5d949d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:31.516489 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9e8099a3-9f91-454e-beda-c2addf3f8463 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:31.524855 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9e8099a3-9f91-454e-beda-c2addf3f8463 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:31.526483 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9e8099a3-9f91-454e-beda-c2addf3f8463 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:31.527852 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9e8099a3-9f91-454e-beda-c2addf3f8463 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1723 microversion: 2.20 time: 0.170316 Jul 15 15:31:31.528990 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 230/458] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:31 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:31:31.611964 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1d31ce19-89fa-47fb-b5fe-d6c37c5d949d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:31.620631 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-1d31ce19-89fa-47fb-b5fe-d6c37c5d949d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1700 microversion: 2.1 time: 0.171388 Jul 15 15:31:31.621409 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 229/459] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:31:31 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1700 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:31.638578 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3ff0d94a-d45d-443c-92d1-e8a244206cc9 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:31:31.645408 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3ff0d94a-d45d-443c-92d1-e8a244206cc9 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:31.645844 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3ff0d94a-d45d-443c-92d1-e8a244206cc9 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:31.672267 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3ff0d94a-d45d-443c-92d1-e8a244206cc9 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Going to try to start instance {{(pid=117998) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 15 15:31:31.722355 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3ff0d94a-d45d-443c-92d1-e8a244206cc9 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "POST /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23/action" status: 202 len: 0 microversion: 2.1 time: 0.088049 Jul 15 15:31:31.723239 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 231/460] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 15 15:31:31 2022] POST /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:31:31.731300 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-cbf392ee-a2f4-494d-95ea-4c8e9fb24bc7 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:31.731892 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-cbf392ee-a2f4-494d-95ea-4c8e9fb24bc7 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:31.738144 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cbf392ee-a2f4-494d-95ea-4c8e9fb24bc7 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:31.738602 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cbf392ee-a2f4-494d-95ea-4c8e9fb24bc7 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:31.739481 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cbf392ee-a2f4-494d-95ea-4c8e9fb24bc7 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:31.739807 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cbf392ee-a2f4-494d-95ea-4c8e9fb24bc7 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:31.912796 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-cbf392ee-a2f4-494d-95ea-4c8e9fb24bc7 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:31.923273 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-cbf392ee-a2f4-494d-95ea-4c8e9fb24bc7 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1709 microversion: 2.1 time: 0.195826 Jul 15 15:31:31.924007 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 230/461] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:31:31 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1709 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:32.548438 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9c568f48-709c-4dd4-9918-5b160fd70043 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:32.549101 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9c568f48-709c-4dd4-9918-5b160fd70043 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:32.555757 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9c568f48-709c-4dd4-9918-5b160fd70043 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:32.556199 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9c568f48-709c-4dd4-9918-5b160fd70043 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:32.556950 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9c568f48-709c-4dd4-9918-5b160fd70043 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:32.557377 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9c568f48-709c-4dd4-9918-5b160fd70043 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:32.704964 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9c568f48-709c-4dd4-9918-5b160fd70043 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:32.713070 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9c568f48-709c-4dd4-9918-5b160fd70043 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:32.714742 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9c568f48-709c-4dd4-9918-5b160fd70043 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:32.715972 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9c568f48-709c-4dd4-9918-5b160fd70043 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1723 microversion: 2.20 time: 0.172482 Jul 15 15:31:32.716521 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 232/462] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:32 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:31:32.942026 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-6e8bffa7-8f11-4a27-9e1c-f90173e95b99 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:32.942662 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-6e8bffa7-8f11-4a27-9e1c-f90173e95b99 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:32.949577 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6e8bffa7-8f11-4a27-9e1c-f90173e95b99 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:32.950100 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6e8bffa7-8f11-4a27-9e1c-f90173e95b99 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:32.950841 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6e8bffa7-8f11-4a27-9e1c-f90173e95b99 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:32.951259 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6e8bffa7-8f11-4a27-9e1c-f90173e95b99 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:33.094778 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6e8bffa7-8f11-4a27-9e1c-f90173e95b99 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:33.103221 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-6e8bffa7-8f11-4a27-9e1c-f90173e95b99 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1709 microversion: 2.1 time: 0.165519 Jul 15 15:31:33.103769 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 231/463] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:31:32 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1709 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:33.734563 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-cc9b56cb-1b2b-460d-be62-bf05831ff8c1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:33.735585 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-cc9b56cb-1b2b-460d-be62-bf05831ff8c1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:33.742393 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cc9b56cb-1b2b-460d-be62-bf05831ff8c1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:33.742957 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cc9b56cb-1b2b-460d-be62-bf05831ff8c1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:33.743620 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cc9b56cb-1b2b-460d-be62-bf05831ff8c1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:33.744055 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cc9b56cb-1b2b-460d-be62-bf05831ff8c1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:33.891182 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-cc9b56cb-1b2b-460d-be62-bf05831ff8c1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:33.899302 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-cc9b56cb-1b2b-460d-be62-bf05831ff8c1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:33.900783 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-cc9b56cb-1b2b-460d-be62-bf05831ff8c1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:33.902378 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-cc9b56cb-1b2b-460d-be62-bf05831ff8c1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1723 microversion: 2.20 time: 0.171383 Jul 15 15:31:33.902963 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 233/464] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:33 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:31:34.121581 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-85259aff-89c6-472c-980d-d3f9056f2f84 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:34.122196 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-85259aff-89c6-472c-980d-d3f9056f2f84 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:34.129278 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-85259aff-89c6-472c-980d-d3f9056f2f84 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:34.129719 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-85259aff-89c6-472c-980d-d3f9056f2f84 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:34.130532 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-85259aff-89c6-472c-980d-d3f9056f2f84 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:34.130955 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-85259aff-89c6-472c-980d-d3f9056f2f84 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:34.289618 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-85259aff-89c6-472c-980d-d3f9056f2f84 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:34.300595 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-85259aff-89c6-472c-980d-d3f9056f2f84 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1709 microversion: 2.1 time: 0.183408 Jul 15 15:31:34.301298 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 232/465] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:31:34 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1709 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:34.925097 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-60d2f5de-24cb-4633-8087-d43da67b806b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:34.932183 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-60d2f5de-24cb-4633-8087-d43da67b806b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:34.939068 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-60d2f5de-24cb-4633-8087-d43da67b806b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:34.939850 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-60d2f5de-24cb-4633-8087-d43da67b806b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:34.941207 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-60d2f5de-24cb-4633-8087-d43da67b806b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:34.941974 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-60d2f5de-24cb-4633-8087-d43da67b806b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:35.094746 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-60d2f5de-24cb-4633-8087-d43da67b806b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:35.102960 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-60d2f5de-24cb-4633-8087-d43da67b806b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:35.104601 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-60d2f5de-24cb-4633-8087-d43da67b806b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:35.106156 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-60d2f5de-24cb-4633-8087-d43da67b806b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1723 microversion: 2.20 time: 0.188546 Jul 15 15:31:35.106749 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 234/466] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:34 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:31:35.321339 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-8471a753-fa0c-4d00-be01-752830d4101e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:35.322103 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-8471a753-fa0c-4d00-be01-752830d4101e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:35.329398 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8471a753-fa0c-4d00-be01-752830d4101e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:35.329836 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8471a753-fa0c-4d00-be01-752830d4101e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:35.330636 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8471a753-fa0c-4d00-be01-752830d4101e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:35.331064 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8471a753-fa0c-4d00-be01-752830d4101e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:35.471495 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-8471a753-fa0c-4d00-be01-752830d4101e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:35.481357 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-8471a753-fa0c-4d00-be01-752830d4101e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1713 microversion: 2.1 time: 0.163908 Jul 15 15:31:35.481918 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 233/467] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:31:35 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1713 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:36.131232 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-09606d4a-ee45-4f1f-9ff3-6b2af284e02e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:36.131832 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-09606d4a-ee45-4f1f-9ff3-6b2af284e02e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:36.140436 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-09606d4a-ee45-4f1f-9ff3-6b2af284e02e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:36.140870 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-09606d4a-ee45-4f1f-9ff3-6b2af284e02e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:36.141635 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-09606d4a-ee45-4f1f-9ff3-6b2af284e02e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:36.142058 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-09606d4a-ee45-4f1f-9ff3-6b2af284e02e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:36.285711 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-09606d4a-ee45-4f1f-9ff3-6b2af284e02e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:36.294383 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-09606d4a-ee45-4f1f-9ff3-6b2af284e02e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:36.296071 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-09606d4a-ee45-4f1f-9ff3-6b2af284e02e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:36.297328 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-09606d4a-ee45-4f1f-9ff3-6b2af284e02e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1723 microversion: 2.20 time: 0.169991 Jul 15 15:31:36.297935 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 235/468] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:36 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:31:37.319386 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3dca88c4-313e-4b86-8a33-accb4b1970a9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:37.319992 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-3dca88c4-313e-4b86-8a33-accb4b1970a9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:37.327332 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3dca88c4-313e-4b86-8a33-accb4b1970a9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:37.327774 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3dca88c4-313e-4b86-8a33-accb4b1970a9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:37.328545 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3dca88c4-313e-4b86-8a33-accb4b1970a9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:37.329005 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3dca88c4-313e-4b86-8a33-accb4b1970a9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:37.484765 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3dca88c4-313e-4b86-8a33-accb4b1970a9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:37.493662 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3dca88c4-313e-4b86-8a33-accb4b1970a9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:37.495478 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3dca88c4-313e-4b86-8a33-accb4b1970a9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:37.496663 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-3dca88c4-313e-4b86-8a33-accb4b1970a9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1723 microversion: 2.20 time: 0.181879 Jul 15 15:31:37.497219 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 234/469] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:37 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:31:38.516665 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6b0c6337-c95a-4ce6-ad52-a22b87174c6b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:38.517305 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6b0c6337-c95a-4ce6-ad52-a22b87174c6b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:38.524287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6b0c6337-c95a-4ce6-ad52-a22b87174c6b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:38.524720 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6b0c6337-c95a-4ce6-ad52-a22b87174c6b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:38.525477 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6b0c6337-c95a-4ce6-ad52-a22b87174c6b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:38.525903 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6b0c6337-c95a-4ce6-ad52-a22b87174c6b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:38.678724 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6b0c6337-c95a-4ce6-ad52-a22b87174c6b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:38.689113 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6b0c6337-c95a-4ce6-ad52-a22b87174c6b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:38.690629 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6b0c6337-c95a-4ce6-ad52-a22b87174c6b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:38.691860 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6b0c6337-c95a-4ce6-ad52-a22b87174c6b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1723 microversion: 2.20 time: 0.179231 Jul 15 15:31:38.692481 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 236/470] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:38 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:31:39.711329 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-029701ae-d47b-4a67-977c-e7cb33c9496c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:39.711943 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-029701ae-d47b-4a67-977c-e7cb33c9496c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:39.719369 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-029701ae-d47b-4a67-977c-e7cb33c9496c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:39.719804 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-029701ae-d47b-4a67-977c-e7cb33c9496c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:39.720585 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-029701ae-d47b-4a67-977c-e7cb33c9496c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:39.721028 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-029701ae-d47b-4a67-977c-e7cb33c9496c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:39.864999 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-029701ae-d47b-4a67-977c-e7cb33c9496c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:39.873545 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-029701ae-d47b-4a67-977c-e7cb33c9496c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:39.875065 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-029701ae-d47b-4a67-977c-e7cb33c9496c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:39.876535 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-029701ae-d47b-4a67-977c-e7cb33c9496c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1723 microversion: 2.20 time: 0.169373 Jul 15 15:31:39.877081 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 235/471] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:39 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:31:40.903264 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d0d7b939-1087-4fff-95b2-17413202a181 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:40.903863 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d0d7b939-1087-4fff-95b2-17413202a181 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:40.910846 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d0d7b939-1087-4fff-95b2-17413202a181 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:40.911287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d0d7b939-1087-4fff-95b2-17413202a181 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:40.912049 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d0d7b939-1087-4fff-95b2-17413202a181 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:40.912474 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d0d7b939-1087-4fff-95b2-17413202a181 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:41.054179 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d0d7b939-1087-4fff-95b2-17413202a181 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:41.062558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d0d7b939-1087-4fff-95b2-17413202a181 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:41.064049 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d0d7b939-1087-4fff-95b2-17413202a181 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:41.065195 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d0d7b939-1087-4fff-95b2-17413202a181 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1744 microversion: 2.20 time: 0.166533 Jul 15 15:31:41.065759 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 237/472] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:40 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:31:42.086274 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-fef7ba68-0f0e-4633-adc6-e8d5dc88512a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:42.087165 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-fef7ba68-0f0e-4633-adc6-e8d5dc88512a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:42.096666 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fef7ba68-0f0e-4633-adc6-e8d5dc88512a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:42.097235 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fef7ba68-0f0e-4633-adc6-e8d5dc88512a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:42.098259 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fef7ba68-0f0e-4633-adc6-e8d5dc88512a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:42.098922 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fef7ba68-0f0e-4633-adc6-e8d5dc88512a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:42.256005 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-fef7ba68-0f0e-4633-adc6-e8d5dc88512a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:42.267135 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-fef7ba68-0f0e-4633-adc6-e8d5dc88512a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:42.268673 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-fef7ba68-0f0e-4633-adc6-e8d5dc88512a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:42.270039 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-fef7ba68-0f0e-4633-adc6-e8d5dc88512a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1744 microversion: 2.20 time: 0.189584 Jul 15 15:31:42.270674 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 236/473] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:42 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1744 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:31:43.289257 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-74860f27-a3e6-4b0b-b3e0-11e0bdf96fb0 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:43.289916 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-74860f27-a3e6-4b0b-b3e0-11e0bdf96fb0 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:43.300014 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-74860f27-a3e6-4b0b-b3e0-11e0bdf96fb0 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:43.300541 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-74860f27-a3e6-4b0b-b3e0-11e0bdf96fb0 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:43.301330 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-74860f27-a3e6-4b0b-b3e0-11e0bdf96fb0 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:43.301780 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-74860f27-a3e6-4b0b-b3e0-11e0bdf96fb0 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:43.401415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-c2628332-26d3-4493-aef7-fe6b0ddbf0f0 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be5d472a-369f-4bf8-913d-8afdc7bee6d7", "device": "/dev/sdb"}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:31:43.403310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-c2628332-26d3-4493-aef7-fe6b0ddbf0f0 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:43.410943 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c2628332-26d3-4493-aef7-fe6b0ddbf0f0 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:43.411353 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c2628332-26d3-4493-aef7-fe6b0ddbf0f0 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:43.412142 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c2628332-26d3-4493-aef7-fe6b0ddbf0f0 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:43.412555 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c2628332-26d3-4493-aef7-fe6b0ddbf0f0 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:43.460176 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-74860f27-a3e6-4b0b-b3e0-11e0bdf96fb0 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:43.472821 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-74860f27-a3e6-4b0b-b3e0-11e0bdf96fb0 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:43.474962 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-74860f27-a3e6-4b0b-b3e0-11e0bdf96fb0 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:43.476488 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-74860f27-a3e6-4b0b-b3e0-11e0bdf96fb0 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1744 microversion: 2.20 time: 0.191179 Jul 15 15:31:43.477218 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 238/474] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:43 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1744 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:31:43.731680 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-c2628332-26d3-4493-aef7-fe6b0ddbf0f0 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "POST /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333560 Jul 15 15:31:43.732352 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 237/475] 10.222.0.40 () {60 vars in 1322 bytes} [Fri Jul 15 15:31:43 2022] POST /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:31:44.328576 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-3445d4ec-34b2-47bb-ac60-3c507f5d453a req-0054a1ae-5091-499c-a5d9-f4c3ce2fb475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5180ff6f-38fa-49c2-9663-9269dcae4849", "name": "network-vif-plugged", "status": "completed", "tag": "03d3bd84-1aa5-4842-b751-250a289b02fe"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:31:44.339218 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-3445d4ec-34b2-47bb-ac60-3c507f5d453a req-0054a1ae-5091-499c-a5d9-f4c3ce2fb475 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:44.339680 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-3445d4ec-34b2-47bb-ac60-3c507f5d453a req-0054a1ae-5091-499c-a5d9-f4c3ce2fb475 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:44.358002 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-3445d4ec-34b2-47bb-ac60-3c507f5d453a req-0054a1ae-5091-499c-a5d9-f4c3ce2fb475 service nova] Creating event network-vif-plugged:03d3bd84-1aa5-4842-b751-250a289b02fe for instance 5180ff6f-38fa-49c2-9663-9269dcae4849 on hv-cinder-85001 Jul 15 15:31:44.367069 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-3445d4ec-34b2-47bb-ac60-3c507f5d453a req-0054a1ae-5091-499c-a5d9-f4c3ce2fb475 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042853 Jul 15 15:31:44.368941 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 239/476] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:31:44.502586 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-f8049ff3-1268-46ac-a3c7-c0d5bfde4499 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:44.503342 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-f8049ff3-1268-46ac-a3c7-c0d5bfde4499 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:44.510866 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f8049ff3-1268-46ac-a3c7-c0d5bfde4499 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:44.511883 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f8049ff3-1268-46ac-a3c7-c0d5bfde4499 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:44.512276 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f8049ff3-1268-46ac-a3c7-c0d5bfde4499 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:44.512774 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f8049ff3-1268-46ac-a3c7-c0d5bfde4499 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:44.660847 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f8049ff3-1268-46ac-a3c7-c0d5bfde4499 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:44.669517 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f8049ff3-1268-46ac-a3c7-c0d5bfde4499 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:44.670999 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f8049ff3-1268-46ac-a3c7-c0d5bfde4499 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:44.672193 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-f8049ff3-1268-46ac-a3c7-c0d5bfde4499 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1744 microversion: 2.20 time: 0.178455 Jul 15 15:31:44.672740 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 238/477] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:44 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1744 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:31:45.692269 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1149ffb2-822e-419b-83e6-bef9764c73a1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:45.692920 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1149ffb2-822e-419b-83e6-bef9764c73a1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:45.699901 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1149ffb2-822e-419b-83e6-bef9764c73a1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:45.700339 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1149ffb2-822e-419b-83e6-bef9764c73a1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:45.701149 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1149ffb2-822e-419b-83e6-bef9764c73a1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:45.701582 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1149ffb2-822e-419b-83e6-bef9764c73a1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:45.871087 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1149ffb2-822e-419b-83e6-bef9764c73a1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:45.874755 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:45.881606 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1149ffb2-822e-419b-83e6-bef9764c73a1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:45.883102 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1149ffb2-822e-419b-83e6-bef9764c73a1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:45.884287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1149ffb2-822e-419b-83e6-bef9764c73a1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1744 microversion: 2.20 time: 0.196971 Jul 15 15:31:45.884835 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 240/478] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:45 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1744 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:31:46.904545 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-bd869be4-ecd8-4133-8f8d-449d6f9b6949 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:46.905239 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-bd869be4-ecd8-4133-8f8d-449d6f9b6949 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:46.912153 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bd869be4-ecd8-4133-8f8d-449d6f9b6949 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:46.912596 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bd869be4-ecd8-4133-8f8d-449d6f9b6949 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:46.913358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bd869be4-ecd8-4133-8f8d-449d6f9b6949 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:46.913788 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bd869be4-ecd8-4133-8f8d-449d6f9b6949 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:47.060323 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-bd869be4-ecd8-4133-8f8d-449d6f9b6949 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:47.073362 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-bd869be4-ecd8-4133-8f8d-449d6f9b6949 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:47.076065 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-bd869be4-ecd8-4133-8f8d-449d6f9b6949 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:47.077587 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-bd869be4-ecd8-4133-8f8d-449d6f9b6949 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1744 microversion: 2.20 time: 0.177137 Jul 15 15:31:47.078240 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 239/479] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:46 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1744 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:31:48.098833 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-92d46e3f-0c50-40bb-96da-ae9b554e41e2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:48.099417 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-92d46e3f-0c50-40bb-96da-ae9b554e41e2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:48.106920 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-92d46e3f-0c50-40bb-96da-ae9b554e41e2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:48.107470 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-92d46e3f-0c50-40bb-96da-ae9b554e41e2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:48.108239 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-92d46e3f-0c50-40bb-96da-ae9b554e41e2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:48.108663 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-92d46e3f-0c50-40bb-96da-ae9b554e41e2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:48.248867 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-92d46e3f-0c50-40bb-96da-ae9b554e41e2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:48.262365 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-92d46e3f-0c50-40bb-96da-ae9b554e41e2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:48.264976 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-92d46e3f-0c50-40bb-96da-ae9b554e41e2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:48.266689 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-92d46e3f-0c50-40bb-96da-ae9b554e41e2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1744 microversion: 2.20 time: 0.172581 Jul 15 15:31:48.267577 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 241/480] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:48 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1744 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:31:49.286694 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-acced8cc-daf1-4bf6-84d8-084709b9162f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:49.287382 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-acced8cc-daf1-4bf6-84d8-084709b9162f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:49.294652 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-acced8cc-daf1-4bf6-84d8-084709b9162f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:49.295087 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-acced8cc-daf1-4bf6-84d8-084709b9162f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:49.295866 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-acced8cc-daf1-4bf6-84d8-084709b9162f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:49.296298 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-acced8cc-daf1-4bf6-84d8-084709b9162f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:49.444685 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-acced8cc-daf1-4bf6-84d8-084709b9162f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:49.453487 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-acced8cc-daf1-4bf6-84d8-084709b9162f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:49.455028 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-acced8cc-daf1-4bf6-84d8-084709b9162f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:49.456187 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-acced8cc-daf1-4bf6-84d8-084709b9162f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1744 microversion: 2.20 time: 0.173533 Jul 15 15:31:49.456738 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 240/481] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:49 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:31:50.474578 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-878ddbcf-4a5b-4098-870d-7cd81aecfc18 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:50.475401 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-878ddbcf-4a5b-4098-870d-7cd81aecfc18 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:50.482578 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-878ddbcf-4a5b-4098-870d-7cd81aecfc18 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:50.483105 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-878ddbcf-4a5b-4098-870d-7cd81aecfc18 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:50.483990 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-878ddbcf-4a5b-4098-870d-7cd81aecfc18 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:50.484444 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-878ddbcf-4a5b-4098-870d-7cd81aecfc18 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:50.629978 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-878ddbcf-4a5b-4098-870d-7cd81aecfc18 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:50.638934 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-878ddbcf-4a5b-4098-870d-7cd81aecfc18 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:50.640457 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-878ddbcf-4a5b-4098-870d-7cd81aecfc18 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:50.641623 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-878ddbcf-4a5b-4098-870d-7cd81aecfc18 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1739 microversion: 2.20 time: 0.171063 Jul 15 15:31:50.642183 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 242/482] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:50 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:31:51.669695 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-9b15177c-2ca4-442b-b6dc-8ed72e740feb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:51.671491 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-9b15177c-2ca4-442b-b6dc-8ed72e740feb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:51.680043 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9b15177c-2ca4-442b-b6dc-8ed72e740feb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:51.680615 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9b15177c-2ca4-442b-b6dc-8ed72e740feb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:51.682050 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9b15177c-2ca4-442b-b6dc-8ed72e740feb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:51.683117 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9b15177c-2ca4-442b-b6dc-8ed72e740feb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:51.886613 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-9b15177c-2ca4-442b-b6dc-8ed72e740feb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:51.902567 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-9b15177c-2ca4-442b-b6dc-8ed72e740feb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:51.904261 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-9b15177c-2ca4-442b-b6dc-8ed72e740feb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:51.905854 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-9b15177c-2ca4-442b-b6dc-8ed72e740feb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1739 microversion: 2.20 time: 0.240468 Jul 15 15:31:51.907001 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 241/483] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:51 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1739 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:31:52.931989 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a6b087fb-95c9-47c6-857c-10839a6f15e2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:52.932861 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a6b087fb-95c9-47c6-857c-10839a6f15e2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:52.940439 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a6b087fb-95c9-47c6-857c-10839a6f15e2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:52.941123 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a6b087fb-95c9-47c6-857c-10839a6f15e2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:52.942510 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a6b087fb-95c9-47c6-857c-10839a6f15e2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:52.943350 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a6b087fb-95c9-47c6-857c-10839a6f15e2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:53.142875 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a6b087fb-95c9-47c6-857c-10839a6f15e2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:53.159978 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a6b087fb-95c9-47c6-857c-10839a6f15e2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:53.161855 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a6b087fb-95c9-47c6-857c-10839a6f15e2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:53.163302 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a6b087fb-95c9-47c6-857c-10839a6f15e2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1739 microversion: 2.20 time: 0.235557 Jul 15 15:31:53.163934 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 243/484] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:52 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1739 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:31:54.183205 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3eba41d6-e7c3-450d-8306-e5e420c36c2b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:54.183849 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-3eba41d6-e7c3-450d-8306-e5e420c36c2b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:54.194262 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3eba41d6-e7c3-450d-8306-e5e420c36c2b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:54.195335 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3eba41d6-e7c3-450d-8306-e5e420c36c2b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:54.196114 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3eba41d6-e7c3-450d-8306-e5e420c36c2b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:54.196549 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3eba41d6-e7c3-450d-8306-e5e420c36c2b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:54.218781 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:54.365373 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3eba41d6-e7c3-450d-8306-e5e420c36c2b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:54.374814 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3eba41d6-e7c3-450d-8306-e5e420c36c2b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:54.376372 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3eba41d6-e7c3-450d-8306-e5e420c36c2b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:54.377546 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-3eba41d6-e7c3-450d-8306-e5e420c36c2b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1739 microversion: 2.20 time: 0.199240 Jul 15 15:31:54.379565 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 242/485] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:54 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:31:55.400988 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-80a5c388-0ce9-4fd6-b180-47d2cfd6feae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:55.402975 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-80a5c388-0ce9-4fd6-b180-47d2cfd6feae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:55.414725 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-80a5c388-0ce9-4fd6-b180-47d2cfd6feae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:55.415909 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-80a5c388-0ce9-4fd6-b180-47d2cfd6feae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:55.417161 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-80a5c388-0ce9-4fd6-b180-47d2cfd6feae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:55.417960 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-80a5c388-0ce9-4fd6-b180-47d2cfd6feae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:55.589687 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-80a5c388-0ce9-4fd6-b180-47d2cfd6feae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:55.600628 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-80a5c388-0ce9-4fd6-b180-47d2cfd6feae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:55.602925 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-80a5c388-0ce9-4fd6-b180-47d2cfd6feae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:55.604455 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-80a5c388-0ce9-4fd6-b180-47d2cfd6feae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1739 microversion: 2.20 time: 0.210497 Jul 15 15:31:55.605452 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 244/486] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:55 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:31:56.628888 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-79f722bd-5edb-49f3-9f54-a18cc80fa246 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:56.629517 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-79f722bd-5edb-49f3-9f54-a18cc80fa246 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:56.644635 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-79f722bd-5edb-49f3-9f54-a18cc80fa246 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:56.645122 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-79f722bd-5edb-49f3-9f54-a18cc80fa246 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:56.645915 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-79f722bd-5edb-49f3-9f54-a18cc80fa246 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:56.646348 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-79f722bd-5edb-49f3-9f54-a18cc80fa246 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:56.829566 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-79f722bd-5edb-49f3-9f54-a18cc80fa246 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:56.840769 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-79f722bd-5edb-49f3-9f54-a18cc80fa246 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:56.842478 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-79f722bd-5edb-49f3-9f54-a18cc80fa246 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:56.850726 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-79f722bd-5edb-49f3-9f54-a18cc80fa246 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1739 microversion: 2.20 time: 0.225594 Jul 15 15:31:56.863352 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 243/487] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:56 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:31:57.872044 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-db8807ab-4f32-4882-ab81-2a30f7276e09 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:57.872645 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-db8807ab-4f32-4882-ab81-2a30f7276e09 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:57.880448 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-db8807ab-4f32-4882-ab81-2a30f7276e09 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:57.880448 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-db8807ab-4f32-4882-ab81-2a30f7276e09 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:57.880448 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-db8807ab-4f32-4882-ab81-2a30f7276e09 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:57.883363 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-db8807ab-4f32-4882-ab81-2a30f7276e09 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:58.048024 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-db8807ab-4f32-4882-ab81-2a30f7276e09 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:58.057606 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-db8807ab-4f32-4882-ab81-2a30f7276e09 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:58.059307 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-db8807ab-4f32-4882-ab81-2a30f7276e09 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:58.060510 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-db8807ab-4f32-4882-ab81-2a30f7276e09 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1739 microversion: 2.20 time: 0.193207 Jul 15 15:31:58.061310 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 245/488] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:57 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:31:59.084221 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-1510a1a6-d911-46b6-84e9-9128b561b24c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:31:59.085552 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-1510a1a6-d911-46b6-84e9-9128b561b24c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:31:59.105005 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1510a1a6-d911-46b6-84e9-9128b561b24c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:59.105518 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1510a1a6-d911-46b6-84e9-9128b561b24c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:59.106603 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1510a1a6-d911-46b6-84e9-9128b561b24c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:31:59.107048 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1510a1a6-d911-46b6-84e9-9128b561b24c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:31:59.335695 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1510a1a6-d911-46b6-84e9-9128b561b24c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:59.350962 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1510a1a6-d911-46b6-84e9-9128b561b24c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:59.353683 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1510a1a6-d911-46b6-84e9-9128b561b24c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:31:59.355763 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-1510a1a6-d911-46b6-84e9-9128b561b24c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1739 microversion: 2.20 time: 0.278191 Jul 15 15:31:59.359096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 244/489] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:31:59 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1739 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:00.377557 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ba70d5e5-5754-45c5-87bd-18e7576eed3e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:00.379065 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ba70d5e5-5754-45c5-87bd-18e7576eed3e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:00.386303 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=34 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:00.389448 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ba70d5e5-5754-45c5-87bd-18e7576eed3e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:00.390022 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ba70d5e5-5754-45c5-87bd-18e7576eed3e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:00.390958 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ba70d5e5-5754-45c5-87bd-18e7576eed3e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:00.391707 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ba70d5e5-5754-45c5-87bd-18e7576eed3e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:00.552597 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ba70d5e5-5754-45c5-87bd-18e7576eed3e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:00.563143 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ba70d5e5-5754-45c5-87bd-18e7576eed3e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:00.564634 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ba70d5e5-5754-45c5-87bd-18e7576eed3e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:00.566020 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ba70d5e5-5754-45c5-87bd-18e7576eed3e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1739 microversion: 2.20 time: 0.194318 Jul 15 15:32:00.566357 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 246/490] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:00 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:01.585503 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-f987c53a-9fce-4f9b-b160-6b9273d54eab tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:01.586282 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-f987c53a-9fce-4f9b-b160-6b9273d54eab tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:01.588682 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=34 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:01.594434 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f987c53a-9fce-4f9b-b160-6b9273d54eab tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:01.594969 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f987c53a-9fce-4f9b-b160-6b9273d54eab tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:01.595748 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f987c53a-9fce-4f9b-b160-6b9273d54eab tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:01.596158 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f987c53a-9fce-4f9b-b160-6b9273d54eab tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:01.754180 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f987c53a-9fce-4f9b-b160-6b9273d54eab tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:01.762744 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f987c53a-9fce-4f9b-b160-6b9273d54eab tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:01.764281 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f987c53a-9fce-4f9b-b160-6b9273d54eab tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:01.765467 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-f987c53a-9fce-4f9b-b160-6b9273d54eab tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1739 microversion: 2.20 time: 0.183922 Jul 15 15:32:01.766027 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 245/491] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:01 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:02.784716 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e5364817-5d61-4115-81f7-b6bb43663641 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:02.785325 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e5364817-5d61-4115-81f7-b6bb43663641 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:02.793176 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e5364817-5d61-4115-81f7-b6bb43663641 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:02.793616 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e5364817-5d61-4115-81f7-b6bb43663641 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:02.794391 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e5364817-5d61-4115-81f7-b6bb43663641 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:02.794845 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e5364817-5d61-4115-81f7-b6bb43663641 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:02.928682 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e5364817-5d61-4115-81f7-b6bb43663641 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:02.937405 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e5364817-5d61-4115-81f7-b6bb43663641 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:02.939122 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e5364817-5d61-4115-81f7-b6bb43663641 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:02.940296 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e5364817-5d61-4115-81f7-b6bb43663641 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1739 microversion: 2.20 time: 0.159690 Jul 15 15:32:02.940857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 247/492] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:02 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:03.958994 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-59f13ff4-6a32-4da7-82d4-70c784683039 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:03.959805 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-59f13ff4-6a32-4da7-82d4-70c784683039 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:03.967209 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-59f13ff4-6a32-4da7-82d4-70c784683039 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:03.967635 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-59f13ff4-6a32-4da7-82d4-70c784683039 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:03.968421 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-59f13ff4-6a32-4da7-82d4-70c784683039 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:03.968847 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-59f13ff4-6a32-4da7-82d4-70c784683039 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:04.119104 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-59f13ff4-6a32-4da7-82d4-70c784683039 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:04.127798 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-59f13ff4-6a32-4da7-82d4-70c784683039 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:04.129375 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-59f13ff4-6a32-4da7-82d4-70c784683039 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:04.130537 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-59f13ff4-6a32-4da7-82d4-70c784683039 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1721 microversion: 2.20 time: 0.175494 Jul 15 15:32:04.131095 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 246/493] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:03 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:05.149566 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0cf24b1d-ef64-4469-b9db-464380c09017 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:05.150144 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-0cf24b1d-ef64-4469-b9db-464380c09017 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:05.158079 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0cf24b1d-ef64-4469-b9db-464380c09017 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:05.158548 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0cf24b1d-ef64-4469-b9db-464380c09017 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:05.159505 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0cf24b1d-ef64-4469-b9db-464380c09017 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:05.159963 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0cf24b1d-ef64-4469-b9db-464380c09017 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:05.332225 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0cf24b1d-ef64-4469-b9db-464380c09017 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:05.346922 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0cf24b1d-ef64-4469-b9db-464380c09017 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:05.349797 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0cf24b1d-ef64-4469-b9db-464380c09017 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:05.351361 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-0cf24b1d-ef64-4469-b9db-464380c09017 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1721 microversion: 2.20 time: 0.205534 Jul 15 15:32:05.352367 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 248/494] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:05 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:06.377993 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-e0294039-c052-4c71-84ea-85053eccc02b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:06.379225 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-e0294039-c052-4c71-84ea-85053eccc02b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:06.389069 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e0294039-c052-4c71-84ea-85053eccc02b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:06.389501 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e0294039-c052-4c71-84ea-85053eccc02b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:06.390274 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e0294039-c052-4c71-84ea-85053eccc02b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:06.390743 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e0294039-c052-4c71-84ea-85053eccc02b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:06.551488 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e0294039-c052-4c71-84ea-85053eccc02b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:06.561319 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e0294039-c052-4c71-84ea-85053eccc02b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:06.563004 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e0294039-c052-4c71-84ea-85053eccc02b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:06.564163 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-e0294039-c052-4c71-84ea-85053eccc02b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1721 microversion: 2.20 time: 0.194265 Jul 15 15:32:06.564740 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 247/495] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:06 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:07.588170 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a3ea4fdb-74aa-419e-81da-c3fccad04f2d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:07.588940 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a3ea4fdb-74aa-419e-81da-c3fccad04f2d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:07.599694 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a3ea4fdb-74aa-419e-81da-c3fccad04f2d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:07.600156 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a3ea4fdb-74aa-419e-81da-c3fccad04f2d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:07.600912 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a3ea4fdb-74aa-419e-81da-c3fccad04f2d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:07.603797 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a3ea4fdb-74aa-419e-81da-c3fccad04f2d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:07.840249 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a3ea4fdb-74aa-419e-81da-c3fccad04f2d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:07.849693 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a3ea4fdb-74aa-419e-81da-c3fccad04f2d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:07.851409 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a3ea4fdb-74aa-419e-81da-c3fccad04f2d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:07.853223 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a3ea4fdb-74aa-419e-81da-c3fccad04f2d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1721 microversion: 2.20 time: 0.269323 Jul 15 15:32:07.854062 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 249/496] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:07 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1721 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:32:07.869662 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-6d122c62-60d3-4e59-814a-f1c6a4d51a41 req-1c6dca32-ab26-4f21-bc0b-d9b6005b5b05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5180ff6f-38fa-49c2-9663-9269dcae4849", "name": "network-vif-unplugged", "status": "completed", "tag": "03d3bd84-1aa5-4842-b751-250a289b02fe"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:32:07.884287 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-6d122c62-60d3-4e59-814a-f1c6a4d51a41 req-1c6dca32-ab26-4f21-bc0b-d9b6005b5b05 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:07.884726 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-6d122c62-60d3-4e59-814a-f1c6a4d51a41 req-1c6dca32-ab26-4f21-bc0b-d9b6005b5b05 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:07.899911 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-6d122c62-60d3-4e59-814a-f1c6a4d51a41 req-1c6dca32-ab26-4f21-bc0b-d9b6005b5b05 service nova] Creating event network-vif-unplugged:03d3bd84-1aa5-4842-b751-250a289b02fe for instance 5180ff6f-38fa-49c2-9663-9269dcae4849 on hv-cinder-85001 Jul 15 15:32:07.913647 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-6d122c62-60d3-4e59-814a-f1c6a4d51a41 req-1c6dca32-ab26-4f21-bc0b-d9b6005b5b05 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048676 Jul 15 15:32:07.914613 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 248/497] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:32:08.872675 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e5eb2389-34a4-44e6-bcc7-afae24b4027d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:08.873601 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e5eb2389-34a4-44e6-bcc7-afae24b4027d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:08.880720 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e5eb2389-34a4-44e6-bcc7-afae24b4027d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:08.881164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e5eb2389-34a4-44e6-bcc7-afae24b4027d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:08.882046 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e5eb2389-34a4-44e6-bcc7-afae24b4027d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:08.882471 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e5eb2389-34a4-44e6-bcc7-afae24b4027d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:09.047167 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e5eb2389-34a4-44e6-bcc7-afae24b4027d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:09.056062 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e5eb2389-34a4-44e6-bcc7-afae24b4027d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:09.057916 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e5eb2389-34a4-44e6-bcc7-afae24b4027d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:09.059366 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e5eb2389-34a4-44e6-bcc7-afae24b4027d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1721 microversion: 2.20 time: 0.190591 Jul 15 15:32:09.059916 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 250/498] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:08 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:10.082281 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-ce76ff3c-f1b3-47fb-8fe3-a0d932e433ed tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:10.083010 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-ce76ff3c-f1b3-47fb-8fe3-a0d932e433ed tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:10.090116 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ce76ff3c-f1b3-47fb-8fe3-a0d932e433ed tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:10.090595 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ce76ff3c-f1b3-47fb-8fe3-a0d932e433ed tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:10.091368 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ce76ff3c-f1b3-47fb-8fe3-a0d932e433ed tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:10.091798 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ce76ff3c-f1b3-47fb-8fe3-a0d932e433ed tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:10.234289 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-ce76ff3c-f1b3-47fb-8fe3-a0d932e433ed tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:10.243257 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-ce76ff3c-f1b3-47fb-8fe3-a0d932e433ed tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:10.244755 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-ce76ff3c-f1b3-47fb-8fe3-a0d932e433ed tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:10.245933 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-ce76ff3c-f1b3-47fb-8fe3-a0d932e433ed tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1664 microversion: 2.20 time: 0.168458 Jul 15 15:32:10.246692 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 249/499] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:10 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1664 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:10.265000 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d745eb5c-9ab6-46b9-bfe5-8e3d1fc73db6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1094eada-0935-47d4-9d6b-628af0af68af"}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:32:10.266360 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d745eb5c-9ab6-46b9-bfe5-8e3d1fc73db6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:10.273311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d745eb5c-9ab6-46b9-bfe5-8e3d1fc73db6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:10.273754 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d745eb5c-9ab6-46b9-bfe5-8e3d1fc73db6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:10.275056 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d745eb5c-9ab6-46b9-bfe5-8e3d1fc73db6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:10.275773 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d745eb5c-9ab6-46b9-bfe5-8e3d1fc73db6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:10.587363 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d745eb5c-9ab6-46b9-bfe5-8e3d1fc73db6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "POST /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.326465 Jul 15 15:32:10.587977 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 251/500] 10.222.0.40 () {62 vars in 1363 bytes} [Fri Jul 15 15:32:10 2022] POST /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849/os-volume_attachments => generated 188 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:32:10.713913 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-2f803b83-79b8-438c-bf9a-2ec1c31776b0 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:32:10.714470 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-2f803b83-79b8-438c-bf9a-2ec1c31776b0 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:10.721175 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2f803b83-79b8-438c-bf9a-2ec1c31776b0 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:10.721615 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2f803b83-79b8-438c-bf9a-2ec1c31776b0 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:10.722365 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2f803b83-79b8-438c-bf9a-2ec1c31776b0 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:10.722822 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2f803b83-79b8-438c-bf9a-2ec1c31776b0 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:10.886543 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-2f803b83-79b8-438c-bf9a-2ec1c31776b0 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "POST /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849/action" status: 202 len: 0 microversion: 2.20 time: 0.176765 Jul 15 15:32:10.887145 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 250/501] 10.222.0.40 () {62 vars in 1318 bytes} [Fri Jul 15 15:32:10 2022] POST /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:32:10.895300 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e5ba8ac2-4b45-4068-9a70-ef7f3554bdee tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:10.895934 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e5ba8ac2-4b45-4068-9a70-ef7f3554bdee tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:10.902895 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e5ba8ac2-4b45-4068-9a70-ef7f3554bdee tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:10.903310 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e5ba8ac2-4b45-4068-9a70-ef7f3554bdee tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:10.904071 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e5ba8ac2-4b45-4068-9a70-ef7f3554bdee tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:10.904488 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e5ba8ac2-4b45-4068-9a70-ef7f3554bdee tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:11.068376 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e5ba8ac2-4b45-4068-9a70-ef7f3554bdee tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:11.080719 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e5ba8ac2-4b45-4068-9a70-ef7f3554bdee tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:11.082402 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e5ba8ac2-4b45-4068-9a70-ef7f3554bdee tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:11.083563 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e5ba8ac2-4b45-4068-9a70-ef7f3554bdee tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1750 microversion: 2.20 time: 0.192200 Jul 15 15:32:11.084305 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 252/502] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:10 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1750 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:12.105035 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-a440b5aa-98f2-4f67-a4cc-323fc199d01a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:12.105625 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-a440b5aa-98f2-4f67-a4cc-323fc199d01a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:12.112167 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a440b5aa-98f2-4f67-a4cc-323fc199d01a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:12.112603 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a440b5aa-98f2-4f67-a4cc-323fc199d01a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:12.113377 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a440b5aa-98f2-4f67-a4cc-323fc199d01a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:12.113798 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a440b5aa-98f2-4f67-a4cc-323fc199d01a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:12.273999 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-a440b5aa-98f2-4f67-a4cc-323fc199d01a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:12.284132 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-a440b5aa-98f2-4f67-a4cc-323fc199d01a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:12.286113 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-a440b5aa-98f2-4f67-a4cc-323fc199d01a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:12.287714 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-a440b5aa-98f2-4f67-a4cc-323fc199d01a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1752 microversion: 2.20 time: 0.187171 Jul 15 15:32:12.288848 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 251/503] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:12 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1752 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:13.027732 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e0e6d1e4-5543-4057-a71a-592714f45027 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:13.028307 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e0e6d1e4-5543-4057-a71a-592714f45027 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:13.035407 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e0e6d1e4-5543-4057-a71a-592714f45027 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:13.035836 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e0e6d1e4-5543-4057-a71a-592714f45027 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:13.036598 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e0e6d1e4-5543-4057-a71a-592714f45027 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:13.037032 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e0e6d1e4-5543-4057-a71a-592714f45027 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:13.173957 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.objects.instance [None req-e0e6d1e4-5543-4057-a71a-592714f45027 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lazy-loading 'services' on Instance uuid 0fc6933f-611e-4adf-84ec-84e9a7fa7c90 {{(pid=117998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:32:13.310041 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-b630a9ca-f76f-4bc1-bba7-ba61c4a99778 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:13.311046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-b630a9ca-f76f-4bc1-bba7-ba61c4a99778 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:13.322933 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b630a9ca-f76f-4bc1-bba7-ba61c4a99778 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:13.323979 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b630a9ca-f76f-4bc1-bba7-ba61c4a99778 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:13.325425 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b630a9ca-f76f-4bc1-bba7-ba61c4a99778 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:13.326152 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b630a9ca-f76f-4bc1-bba7-ba61c4a99778 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:13.330164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e0e6d1e4-5543-4057-a71a-592714f45027 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90/os-volume_attachments/be5d472a-369f-4bf8-913d-8afdc7bee6d7" status: 202 len: 0 microversion: 2.1 time: 0.308820 Jul 15 15:32:13.331797 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 253/504] 10.222.0.40 () {58 vars in 1415 bytes} [Fri Jul 15 15:32:13 2022] DELETE /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90/os-volume_attachments/be5d472a-369f-4bf8-913d-8afdc7bee6d7 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:32:13.545742 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b630a9ca-f76f-4bc1-bba7-ba61c4a99778 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:13.557015 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b630a9ca-f76f-4bc1-bba7-ba61c4a99778 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:13.558581 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b630a9ca-f76f-4bc1-bba7-ba61c4a99778 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:13.559782 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-b630a9ca-f76f-4bc1-bba7-ba61c4a99778 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.256359 Jul 15 15:32:13.560350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 252/505] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:13 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:32:14.496049 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a8870cde-4633-46d7-b406-de7ba7d1dcb2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:14.496625 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a8870cde-4633-46d7-b406-de7ba7d1dcb2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:14.506664 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a8870cde-4633-46d7-b406-de7ba7d1dcb2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:14.507274 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a8870cde-4633-46d7-b406-de7ba7d1dcb2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:14.508643 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a8870cde-4633-46d7-b406-de7ba7d1dcb2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:14.509404 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a8870cde-4633-46d7-b406-de7ba7d1dcb2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:14.531631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:14.541018 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a8870cde-4633-46d7-b406-de7ba7d1dcb2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Going to try to terminate instance {{(pid=117998) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 15:32:14.579204 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-27bf4795-060c-4f66-9d2a-92a067014d94 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:14.579952 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-27bf4795-060c-4f66-9d2a-92a067014d94 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:14.587459 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-27bf4795-060c-4f66-9d2a-92a067014d94 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:14.588216 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-27bf4795-060c-4f66-9d2a-92a067014d94 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:14.589154 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-27bf4795-060c-4f66-9d2a-92a067014d94 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:14.590136 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-27bf4795-060c-4f66-9d2a-92a067014d94 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:14.672414 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a8870cde-4633-46d7-b406-de7ba7d1dcb2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 204 len: 0 microversion: 2.1 time: 0.184395 Jul 15 15:32:14.673471 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 254/506] 10.222.0.40 () {58 vars in 1238 bytes} [Fri Jul 15 15:32:14 2022] DELETE /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:32:14.696596 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-15973635-23d9-456e-9f79-82bf8fbf6244 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:14.699661 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-15973635-23d9-456e-9f79-82bf8fbf6244 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:14.708577 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-15973635-23d9-456e-9f79-82bf8fbf6244 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:14.709843 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-15973635-23d9-456e-9f79-82bf8fbf6244 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:14.711143 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-15973635-23d9-456e-9f79-82bf8fbf6244 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:14.712811 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-15973635-23d9-456e-9f79-82bf8fbf6244 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:14.909069 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-27bf4795-060c-4f66-9d2a-92a067014d94 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:14.923231 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-27bf4795-060c-4f66-9d2a-92a067014d94 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:14.924907 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-27bf4795-060c-4f66-9d2a-92a067014d94 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:14.926212 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-27bf4795-060c-4f66-9d2a-92a067014d94 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.351497 Jul 15 15:32:14.926901 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 253/507] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:14 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:32:15.018326 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-15973635-23d9-456e-9f79-82bf8fbf6244 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:15.028942 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-15973635-23d9-456e-9f79-82bf8fbf6244 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 200 len: 1513 microversion: 2.1 time: 0.350547 Jul 15 15:32:15.029904 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 255/508] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:14 2022] GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 1513 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:32:15.953041 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-29bfae3c-1abf-46b7-985b-c59ae15fa57b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:15.953645 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-29bfae3c-1abf-46b7-985b-c59ae15fa57b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:15.960583 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-29bfae3c-1abf-46b7-985b-c59ae15fa57b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:15.961304 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-29bfae3c-1abf-46b7-985b-c59ae15fa57b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:15.962068 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-29bfae3c-1abf-46b7-985b-c59ae15fa57b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:15.962490 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-29bfae3c-1abf-46b7-985b-c59ae15fa57b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:16.049966 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f4b16733-06af-4f11-8468-a2c8d574a4c2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:16.050860 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f4b16733-06af-4f11-8468-a2c8d574a4c2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:16.058861 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f4b16733-06af-4f11-8468-a2c8d574a4c2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:16.059287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f4b16733-06af-4f11-8468-a2c8d574a4c2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:16.060074 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f4b16733-06af-4f11-8468-a2c8d574a4c2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:16.060484 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f4b16733-06af-4f11-8468-a2c8d574a4c2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:16.123954 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-29bfae3c-1abf-46b7-985b-c59ae15fa57b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:16.134162 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-29bfae3c-1abf-46b7-985b-c59ae15fa57b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:16.135765 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-29bfae3c-1abf-46b7-985b-c59ae15fa57b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:16.136984 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-29bfae3c-1abf-46b7-985b-c59ae15fa57b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.189845 Jul 15 15:32:16.137538 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 254/509] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:15 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:16.225010 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f4b16733-06af-4f11-8468-a2c8d574a4c2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:16.234454 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f4b16733-06af-4f11-8468-a2c8d574a4c2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 200 len: 1513 microversion: 2.1 time: 0.189122 Jul 15 15:32:16.235087 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 256/510] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:16 2022] GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 1513 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:32:17.156578 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-81c87b45-54f1-43d9-837f-da2f8c60c5ae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:17.158000 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-81c87b45-54f1-43d9-837f-da2f8c60c5ae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:17.166473 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-81c87b45-54f1-43d9-837f-da2f8c60c5ae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:17.167129 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-81c87b45-54f1-43d9-837f-da2f8c60c5ae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:17.167976 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-81c87b45-54f1-43d9-837f-da2f8c60c5ae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:17.168474 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-81c87b45-54f1-43d9-837f-da2f8c60c5ae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:17.253018 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-28f6ca96-14d7-491f-950b-3b231c509543 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:17.254885 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-28f6ca96-14d7-491f-950b-3b231c509543 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:17.262951 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-28f6ca96-14d7-491f-950b-3b231c509543 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:17.263396 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-28f6ca96-14d7-491f-950b-3b231c509543 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:17.264556 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-28f6ca96-14d7-491f-950b-3b231c509543 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:17.264987 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-28f6ca96-14d7-491f-950b-3b231c509543 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:17.340879 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-81c87b45-54f1-43d9-837f-da2f8c60c5ae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:17.350189 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-81c87b45-54f1-43d9-837f-da2f8c60c5ae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:17.351905 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-81c87b45-54f1-43d9-837f-da2f8c60c5ae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:17.353080 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-81c87b45-54f1-43d9-837f-da2f8c60c5ae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.200886 Jul 15 15:32:17.353608 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 255/511] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:17 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:17.448294 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-28f6ca96-14d7-491f-950b-3b231c509543 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:17.455922 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-28f6ca96-14d7-491f-950b-3b231c509543 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 200 len: 1513 microversion: 2.1 time: 0.207458 Jul 15 15:32:17.456492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 257/512] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:17 2022] GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 1513 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:32:18.394635 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-47c38659-78da-41fa-b62c-21e0088c6f76 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:18.395741 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-47c38659-78da-41fa-b62c-21e0088c6f76 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:18.404216 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-47c38659-78da-41fa-b62c-21e0088c6f76 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:18.404929 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-47c38659-78da-41fa-b62c-21e0088c6f76 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:18.405691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-47c38659-78da-41fa-b62c-21e0088c6f76 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:18.406108 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-47c38659-78da-41fa-b62c-21e0088c6f76 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:18.474713 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-bd75ce33-4e09-437a-979a-82385f6adc90 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:18.475579 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-bd75ce33-4e09-437a-979a-82385f6adc90 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:18.482970 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bd75ce33-4e09-437a-979a-82385f6adc90 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:18.483524 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bd75ce33-4e09-437a-979a-82385f6adc90 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:18.485165 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bd75ce33-4e09-437a-979a-82385f6adc90 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:18.485165 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bd75ce33-4e09-437a-979a-82385f6adc90 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:18.612208 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-47c38659-78da-41fa-b62c-21e0088c6f76 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:18.623200 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-47c38659-78da-41fa-b62c-21e0088c6f76 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:18.624703 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-47c38659-78da-41fa-b62c-21e0088c6f76 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:18.625869 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-47c38659-78da-41fa-b62c-21e0088c6f76 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.255616 Jul 15 15:32:18.626416 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 256/513] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:18 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:18.670430 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-bd75ce33-4e09-437a-979a-82385f6adc90 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:18.679174 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-bd75ce33-4e09-437a-979a-82385f6adc90 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 200 len: 1513 microversion: 2.1 time: 0.208647 Jul 15 15:32:18.680536 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 258/514] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:18 2022] GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 1513 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:32:19.645924 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-e6e52eda-db37-479e-ad0f-6383fa575844 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:19.647105 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-e6e52eda-db37-479e-ad0f-6383fa575844 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:19.654085 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e6e52eda-db37-479e-ad0f-6383fa575844 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:19.654506 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e6e52eda-db37-479e-ad0f-6383fa575844 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:19.655292 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e6e52eda-db37-479e-ad0f-6383fa575844 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:19.655713 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e6e52eda-db37-479e-ad0f-6383fa575844 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:19.703740 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a94f480f-dce6-489b-be2d-e2c03fe0bc86 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:19.705163 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a94f480f-dce6-489b-be2d-e2c03fe0bc86 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:19.714804 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a94f480f-dce6-489b-be2d-e2c03fe0bc86 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:19.715632 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a94f480f-dce6-489b-be2d-e2c03fe0bc86 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:19.716527 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a94f480f-dce6-489b-be2d-e2c03fe0bc86 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:19.716959 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a94f480f-dce6-489b-be2d-e2c03fe0bc86 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:19.902785 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e6e52eda-db37-479e-ad0f-6383fa575844 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:19.912292 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e6e52eda-db37-479e-ad0f-6383fa575844 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:19.913935 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e6e52eda-db37-479e-ad0f-6383fa575844 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:19.915315 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-e6e52eda-db37-479e-ad0f-6383fa575844 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.273319 Jul 15 15:32:19.915956 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 257/515] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:19 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:19.931808 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a94f480f-dce6-489b-be2d-e2c03fe0bc86 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:19.943395 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a94f480f-dce6-489b-be2d-e2c03fe0bc86 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 200 len: 1513 microversion: 2.1 time: 0.249759 Jul 15 15:32:19.943986 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 259/516] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:19 2022] GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 1513 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:32:20.934492 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-825a54ad-b710-47f4-8fd1-07c9ab7f43e7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:20.935299 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-825a54ad-b710-47f4-8fd1-07c9ab7f43e7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:20.942837 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-825a54ad-b710-47f4-8fd1-07c9ab7f43e7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:20.943562 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-825a54ad-b710-47f4-8fd1-07c9ab7f43e7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:20.944656 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-825a54ad-b710-47f4-8fd1-07c9ab7f43e7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:20.945281 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-825a54ad-b710-47f4-8fd1-07c9ab7f43e7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:20.961512 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9bdd07a8-f865-4e6c-9ed0-7124cfdac42e tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:20.962174 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9bdd07a8-f865-4e6c-9ed0-7124cfdac42e tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:20.966914 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:20.969373 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9bdd07a8-f865-4e6c-9ed0-7124cfdac42e tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:20.969844 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9bdd07a8-f865-4e6c-9ed0-7124cfdac42e tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:20.970763 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9bdd07a8-f865-4e6c-9ed0-7124cfdac42e tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:20.971194 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9bdd07a8-f865-4e6c-9ed0-7124cfdac42e tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:21.170815 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-825a54ad-b710-47f4-8fd1-07c9ab7f43e7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:21.193114 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-825a54ad-b710-47f4-8fd1-07c9ab7f43e7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:21.195935 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-825a54ad-b710-47f4-8fd1-07c9ab7f43e7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:21.197921 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-825a54ad-b710-47f4-8fd1-07c9ab7f43e7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.267819 Jul 15 15:32:21.202418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 258/517] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:20 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:21.209609 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9bdd07a8-f865-4e6c-9ed0-7124cfdac42e tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:21.222006 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9bdd07a8-f865-4e6c-9ed0-7124cfdac42e tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 200 len: 1513 microversion: 2.1 time: 0.264209 Jul 15 15:32:21.222860 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 260/518] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:20 2022] GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 1513 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:32:22.222570 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-91a0ea29-759e-4b0b-9ba3-3c5aced08f0d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:22.223173 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-91a0ea29-759e-4b0b-9ba3-3c5aced08f0d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:22.230652 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-91a0ea29-759e-4b0b-9ba3-3c5aced08f0d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:22.231080 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-91a0ea29-759e-4b0b-9ba3-3c5aced08f0d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:22.231836 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-91a0ea29-759e-4b0b-9ba3-3c5aced08f0d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:22.232247 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-91a0ea29-759e-4b0b-9ba3-3c5aced08f0d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:22.241421 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1f5156c8-1e39-4fcc-b577-0b63e632d3ae tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:22.243317 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1f5156c8-1e39-4fcc-b577-0b63e632d3ae tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:22.253442 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1f5156c8-1e39-4fcc-b577-0b63e632d3ae tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:22.254712 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1f5156c8-1e39-4fcc-b577-0b63e632d3ae tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:22.255602 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1f5156c8-1e39-4fcc-b577-0b63e632d3ae tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:22.256240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1f5156c8-1e39-4fcc-b577-0b63e632d3ae tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:22.452846 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-91a0ea29-759e-4b0b-9ba3-3c5aced08f0d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:22.468122 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1f5156c8-1e39-4fcc-b577-0b63e632d3ae tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:22.468936 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-91a0ea29-759e-4b0b-9ba3-3c5aced08f0d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:22.471902 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-91a0ea29-759e-4b0b-9ba3-3c5aced08f0d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:22.474084 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-91a0ea29-759e-4b0b-9ba3-3c5aced08f0d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.255163 Jul 15 15:32:22.475423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 259/519] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:22 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:22.481206 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1f5156c8-1e39-4fcc-b577-0b63e632d3ae tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 200 len: 1513 microversion: 2.1 time: 0.243679 Jul 15 15:32:22.492400 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 261/520] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:22 2022] GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 1513 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:32:23.496414 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-0815c2a5-f2fa-499b-b364-a3339f8efc6e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:23.497410 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-0815c2a5-f2fa-499b-b364-a3339f8efc6e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:23.500556 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f9284673-ddad-4ca6-9f33-cd63db486265 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:23.501707 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f9284673-ddad-4ca6-9f33-cd63db486265 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:23.510016 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0815c2a5-f2fa-499b-b364-a3339f8efc6e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:23.510625 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0815c2a5-f2fa-499b-b364-a3339f8efc6e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:23.511665 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0815c2a5-f2fa-499b-b364-a3339f8efc6e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:23.512127 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f9284673-ddad-4ca6-9f33-cd63db486265 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:23.512498 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0815c2a5-f2fa-499b-b364-a3339f8efc6e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:23.513039 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f9284673-ddad-4ca6-9f33-cd63db486265 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:23.513516 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f9284673-ddad-4ca6-9f33-cd63db486265 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:23.513949 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f9284673-ddad-4ca6-9f33-cd63db486265 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:23.748919 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-0815c2a5-f2fa-499b-b364-a3339f8efc6e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:23.753001 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f9284673-ddad-4ca6-9f33-cd63db486265 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:23.758992 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-0815c2a5-f2fa-499b-b364-a3339f8efc6e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:23.760923 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-0815c2a5-f2fa-499b-b364-a3339f8efc6e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:23.762169 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-0815c2a5-f2fa-499b-b364-a3339f8efc6e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.271953 Jul 15 15:32:23.762843 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 260/521] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:23 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:23.773210 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f9284673-ddad-4ca6-9f33-cd63db486265 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 200 len: 1513 microversion: 2.1 time: 0.276938 Jul 15 15:32:23.774356 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 262/522] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:23 2022] GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 1513 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:32:24.784415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-2386b8c6-8c19-44d4-a3ba-0cc9925b5528 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:24.785318 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-2386b8c6-8c19-44d4-a3ba-0cc9925b5528 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:24.793557 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2386b8c6-8c19-44d4-a3ba-0cc9925b5528 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:24.795596 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2386b8c6-8c19-44d4-a3ba-0cc9925b5528 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:24.796577 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2386b8c6-8c19-44d4-a3ba-0cc9925b5528 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:24.797024 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2386b8c6-8c19-44d4-a3ba-0cc9925b5528 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:24.800794 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4334176a-5554-4ff8-b921-3b2de11dd8fc tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:24.801382 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-4334176a-5554-4ff8-b921-3b2de11dd8fc tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:24.812430 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4334176a-5554-4ff8-b921-3b2de11dd8fc tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:24.814013 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4334176a-5554-4ff8-b921-3b2de11dd8fc tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:24.814013 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4334176a-5554-4ff8-b921-3b2de11dd8fc tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:24.814013 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4334176a-5554-4ff8-b921-3b2de11dd8fc tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:25.017191 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-2386b8c6-8c19-44d4-a3ba-0cc9925b5528 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:25.032742 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-2386b8c6-8c19-44d4-a3ba-0cc9925b5528 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:25.036022 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-2386b8c6-8c19-44d4-a3ba-0cc9925b5528 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:25.038115 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-2386b8c6-8c19-44d4-a3ba-0cc9925b5528 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.260183 Jul 15 15:32:25.039142 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 261/523] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:24 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:25.052353 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-4334176a-5554-4ff8-b921-3b2de11dd8fc tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:25.060638 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4334176a-5554-4ff8-b921-3b2de11dd8fc tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 200 len: 1513 microversion: 2.1 time: 0.263961 Jul 15 15:32:25.061289 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 263/524] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:24 2022] GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 1513 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:32:26.059755 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-f3c81e3c-3e1a-4b00-9aa7-95a34e62c0b1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:26.060465 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-f3c81e3c-3e1a-4b00-9aa7-95a34e62c0b1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:26.067579 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f3c81e3c-3e1a-4b00-9aa7-95a34e62c0b1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:26.068087 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f3c81e3c-3e1a-4b00-9aa7-95a34e62c0b1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:26.068865 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f3c81e3c-3e1a-4b00-9aa7-95a34e62c0b1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:26.069290 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f3c81e3c-3e1a-4b00-9aa7-95a34e62c0b1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:26.081267 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-50f691e6-152b-4191-a0c2-87c9031a57aa tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:26.081890 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-50f691e6-152b-4191-a0c2-87c9031a57aa tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:26.089979 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-50f691e6-152b-4191-a0c2-87c9031a57aa tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:26.090307 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-50f691e6-152b-4191-a0c2-87c9031a57aa tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:26.091046 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-50f691e6-152b-4191-a0c2-87c9031a57aa tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:26.091472 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-50f691e6-152b-4191-a0c2-87c9031a57aa tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:26.285637 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f3c81e3c-3e1a-4b00-9aa7-95a34e62c0b1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:26.294984 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f3c81e3c-3e1a-4b00-9aa7-95a34e62c0b1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:26.296478 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f3c81e3c-3e1a-4b00-9aa7-95a34e62c0b1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:26.297644 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-f3c81e3c-3e1a-4b00-9aa7-95a34e62c0b1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.242498 Jul 15 15:32:26.298906 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 262/525] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:26 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:26.301662 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-50f691e6-152b-4191-a0c2-87c9031a57aa tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:26.312317 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-50f691e6-152b-4191-a0c2-87c9031a57aa tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 200 len: 1513 microversion: 2.1 time: 0.234936 Jul 15 15:32:26.312916 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 264/526] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:26 2022] GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 1513 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:32:27.318579 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-df6d147d-7580-4453-8f73-ebfd9713b1e6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:27.319203 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-df6d147d-7580-4453-8f73-ebfd9713b1e6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:27.326790 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-df6d147d-7580-4453-8f73-ebfd9713b1e6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:27.327619 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-df6d147d-7580-4453-8f73-ebfd9713b1e6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:27.328215 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-df6d147d-7580-4453-8f73-ebfd9713b1e6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:27.328940 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-df6d147d-7580-4453-8f73-ebfd9713b1e6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:27.331337 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0f85c978-1682-4a9b-bb5c-097bb3979a80 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:27.331980 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-0f85c978-1682-4a9b-bb5c-097bb3979a80 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:27.339400 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0f85c978-1682-4a9b-bb5c-097bb3979a80 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:27.339872 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0f85c978-1682-4a9b-bb5c-097bb3979a80 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:27.340633 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0f85c978-1682-4a9b-bb5c-097bb3979a80 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:27.341059 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0f85c978-1682-4a9b-bb5c-097bb3979a80 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:27.542473 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-df6d147d-7580-4453-8f73-ebfd9713b1e6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:27.545330 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0f85c978-1682-4a9b-bb5c-097bb3979a80 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:27.553190 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-0f85c978-1682-4a9b-bb5c-097bb3979a80 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 200 len: 1513 microversion: 2.1 time: 0.226193 Jul 15 15:32:27.553743 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 265/527] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:27 2022] GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 1513 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:32:27.554567 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-df6d147d-7580-4453-8f73-ebfd9713b1e6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:27.556113 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-df6d147d-7580-4453-8f73-ebfd9713b1e6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:27.557299 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-df6d147d-7580-4453-8f73-ebfd9713b1e6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.242840 Jul 15 15:32:27.557821 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 263/528] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:27 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:28.571457 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a4b40723-43e1-4812-b0e7-e21029df6707 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:28.572062 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a4b40723-43e1-4812-b0e7-e21029df6707 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:28.576601 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-158057f3-f8e5-4c2f-8d22-3dd6c0d1063f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:28.577207 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-158057f3-f8e5-4c2f-8d22-3dd6c0d1063f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:28.579228 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a4b40723-43e1-4812-b0e7-e21029df6707 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:28.579667 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a4b40723-43e1-4812-b0e7-e21029df6707 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:28.580751 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a4b40723-43e1-4812-b0e7-e21029df6707 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:28.580904 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a4b40723-43e1-4812-b0e7-e21029df6707 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:28.584203 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-158057f3-f8e5-4c2f-8d22-3dd6c0d1063f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:28.584645 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-158057f3-f8e5-4c2f-8d22-3dd6c0d1063f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:28.585408 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-158057f3-f8e5-4c2f-8d22-3dd6c0d1063f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:28.585836 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-158057f3-f8e5-4c2f-8d22-3dd6c0d1063f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:28.784077 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a4b40723-43e1-4812-b0e7-e21029df6707 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:28.785795 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-158057f3-f8e5-4c2f-8d22-3dd6c0d1063f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:28.790957 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a4b40723-43e1-4812-b0e7-e21029df6707 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 200 len: 1513 microversion: 2.1 time: 0.223548 Jul 15 15:32:28.791641 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 266/529] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:28 2022] GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 1513 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:32:28.796490 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-158057f3-f8e5-4c2f-8d22-3dd6c0d1063f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:28.798051 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-158057f3-f8e5-4c2f-8d22-3dd6c0d1063f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:28.799422 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-158057f3-f8e5-4c2f-8d22-3dd6c0d1063f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.226914 Jul 15 15:32:28.800143 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 264/530] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:28 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:32:29.812304 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2a706a8e-0343-40f3-b736-4688437569a2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:29.813019 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-2a706a8e-0343-40f3-b736-4688437569a2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:29.817764 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-2970fe49-20a5-428c-b75e-e99343bcd442 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:29.818363 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-2970fe49-20a5-428c-b75e-e99343bcd442 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:29.820753 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2a706a8e-0343-40f3-b736-4688437569a2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:29.821233 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2a706a8e-0343-40f3-b736-4688437569a2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:29.822297 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2a706a8e-0343-40f3-b736-4688437569a2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:29.822407 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2a706a8e-0343-40f3-b736-4688437569a2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:29.825444 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2970fe49-20a5-428c-b75e-e99343bcd442 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:29.825894 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2970fe49-20a5-428c-b75e-e99343bcd442 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:29.826748 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2970fe49-20a5-428c-b75e-e99343bcd442 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:29.827170 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2970fe49-20a5-428c-b75e-e99343bcd442 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:30.034690 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2a706a8e-0343-40f3-b736-4688437569a2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:30.038420 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-2970fe49-20a5-428c-b75e-e99343bcd442 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:30.044219 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-2a706a8e-0343-40f3-b736-4688437569a2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 200 len: 1513 microversion: 2.1 time: 0.235745 Jul 15 15:32:30.044907 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 267/531] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:29 2022] GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 1513 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:32:30.049891 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-2970fe49-20a5-428c-b75e-e99343bcd442 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:30.052479 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-2970fe49-20a5-428c-b75e-e99343bcd442 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:30.054091 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-2970fe49-20a5-428c-b75e-e99343bcd442 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.240520 Jul 15 15:32:30.054757 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 265/532] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:29 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:31.061901 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a67b2473-a11b-490e-9dbc-2de94e8c91c2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:31.062711 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a67b2473-a11b-490e-9dbc-2de94e8c91c2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:31.066340 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:31.074437 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a67b2473-a11b-490e-9dbc-2de94e8c91c2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:31.074947 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a67b2473-a11b-490e-9dbc-2de94e8c91c2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:31.075644 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a67b2473-a11b-490e-9dbc-2de94e8c91c2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:31.076064 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a67b2473-a11b-490e-9dbc-2de94e8c91c2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:31.076489 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-dc37c966-b240-4534-8b71-e5a1d8b47eb2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:31.077208 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-dc37c966-b240-4534-8b71-e5a1d8b47eb2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:31.084188 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-dc37c966-b240-4534-8b71-e5a1d8b47eb2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:31.084628 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-dc37c966-b240-4534-8b71-e5a1d8b47eb2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:31.092022 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-dc37c966-b240-4534-8b71-e5a1d8b47eb2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:31.092455 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-dc37c966-b240-4534-8b71-e5a1d8b47eb2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:31.292259 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-dc37c966-b240-4534-8b71-e5a1d8b47eb2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:31.296467 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a67b2473-a11b-490e-9dbc-2de94e8c91c2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:31.300992 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-dc37c966-b240-4534-8b71-e5a1d8b47eb2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:31.302477 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-dc37c966-b240-4534-8b71-e5a1d8b47eb2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:31.303659 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-dc37c966-b240-4534-8b71-e5a1d8b47eb2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.232140 Jul 15 15:32:31.304028 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a67b2473-a11b-490e-9dbc-2de94e8c91c2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 200 len: 1513 microversion: 2.1 time: 0.246184 Jul 15 15:32:31.306404 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 266/533] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:31 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:32:31.306581 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 268/534] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:31 2022] GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 1513 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:32:32.322954 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-57d9fa2d-a49b-425a-98db-7c7f47a5369d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:32.323932 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-57d9fa2d-a49b-425a-98db-7c7f47a5369d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:32.324283 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-aebe214b-8b88-4898-bece-a8e447352977 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:32.325015 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-aebe214b-8b88-4898-bece-a8e447352977 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:32.327505 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=46 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:32.332295 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-57d9fa2d-a49b-425a-98db-7c7f47a5369d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:32.332857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-57d9fa2d-a49b-425a-98db-7c7f47a5369d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:32.333200 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-aebe214b-8b88-4898-bece-a8e447352977 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:32.333646 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-aebe214b-8b88-4898-bece-a8e447352977 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:32.333910 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-57d9fa2d-a49b-425a-98db-7c7f47a5369d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:32.334410 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-aebe214b-8b88-4898-bece-a8e447352977 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:32.334605 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-57d9fa2d-a49b-425a-98db-7c7f47a5369d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:32.334863 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-aebe214b-8b88-4898-bece-a8e447352977 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:32.339755 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:32.539693 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-57d9fa2d-a49b-425a-98db-7c7f47a5369d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:32.543352 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-aebe214b-8b88-4898-bece-a8e447352977 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:32.548702 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-57d9fa2d-a49b-425a-98db-7c7f47a5369d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:32.550293 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-57d9fa2d-a49b-425a-98db-7c7f47a5369d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:32.550977 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-aebe214b-8b88-4898-bece-a8e447352977 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 200 len: 1513 microversion: 2.1 time: 0.232048 Jul 15 15:32:32.551527 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 267/535] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:32 2022] GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 1513 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:32:32.551758 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-57d9fa2d-a49b-425a-98db-7c7f47a5369d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.232953 Jul 15 15:32:32.552077 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 269/536] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:32 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:33.569123 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-9becebe5-fb54-40b5-9b58-69cdd2b5ec12 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:33.569694 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1acbe17f-3801-4693-a72b-038f287a31ec tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:33.570068 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1acbe17f-3801-4693-a72b-038f287a31ec tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:33.570896 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-9becebe5-fb54-40b5-9b58-69cdd2b5ec12 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:33.577683 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9becebe5-fb54-40b5-9b58-69cdd2b5ec12 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:33.577892 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1acbe17f-3801-4693-a72b-038f287a31ec tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:33.578126 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9becebe5-fb54-40b5-9b58-69cdd2b5ec12 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:33.578238 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1acbe17f-3801-4693-a72b-038f287a31ec tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:33.578935 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9becebe5-fb54-40b5-9b58-69cdd2b5ec12 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:33.579177 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1acbe17f-3801-4693-a72b-038f287a31ec tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:33.579344 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9becebe5-fb54-40b5-9b58-69cdd2b5ec12 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:33.579722 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1acbe17f-3801-4693-a72b-038f287a31ec tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:33.993777 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1acbe17f-3801-4693-a72b-038f287a31ec tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:34.003055 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-9becebe5-fb54-40b5-9b58-69cdd2b5ec12 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:34.004563 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1acbe17f-3801-4693-a72b-038f287a31ec tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:34.006465 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1acbe17f-3801-4693-a72b-038f287a31ec tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:34.007452 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1acbe17f-3801-4693-a72b-038f287a31ec tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.442077 Jul 15 15:32:34.008191 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 270/537] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:33 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:34.012178 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-9becebe5-fb54-40b5-9b58-69cdd2b5ec12 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 200 len: 1513 microversion: 2.1 time: 0.446803 Jul 15 15:32:34.021962 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 268/538] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:33 2022] GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 1513 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:32:34.280153 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-633d2aba-b785-4c73-9eb3-28dbf807c9ab req-2bc46471-4e7f-426c-b893-d6b5f642c91b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fc6933f-611e-4adf-84ec-84e9a7fa7c90", "name": "network-vif-deleted", "tag": "58dd8bb7-91bb-4467-80df-f93d4a33ef05"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:32:34.288475 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-633d2aba-b785-4c73-9eb3-28dbf807c9ab req-2bc46471-4e7f-426c-b893-d6b5f642c91b service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:34.289236 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-633d2aba-b785-4c73-9eb3-28dbf807c9ab req-2bc46471-4e7f-426c-b893-d6b5f642c91b service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:34.302042 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-633d2aba-b785-4c73-9eb3-28dbf807c9ab req-2bc46471-4e7f-426c-b893-d6b5f642c91b service nova] Creating event network-vif-deleted:58dd8bb7-91bb-4467-80df-f93d4a33ef05 for instance 0fc6933f-611e-4adf-84ec-84e9a7fa7c90 on hv-cinder-85001 Jul 15 15:32:34.307569 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-633d2aba-b785-4c73-9eb3-28dbf807c9ab req-2bc46471-4e7f-426c-b893-d6b5f642c91b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124638 Jul 15 15:32:34.308974 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 271/539] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:32:35.028167 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-56df61c7-6f80-4436-86c5-2ed63b21d436 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:35.028732 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-56df61c7-6f80-4436-86c5-2ed63b21d436 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:35.033554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1a04e5ea-469a-4a4a-9772-a6e3d5212f13 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:35.034255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1a04e5ea-469a-4a4a-9772-a6e3d5212f13 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 0fc6933f-611e-4adf-84ec-84e9a7fa7c90] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:35.035718 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-56df61c7-6f80-4436-86c5-2ed63b21d436 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:35.036163 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-56df61c7-6f80-4436-86c5-2ed63b21d436 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:35.036933 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-56df61c7-6f80-4436-86c5-2ed63b21d436 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:35.037360 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-56df61c7-6f80-4436-86c5-2ed63b21d436 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:35.040767 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1a04e5ea-469a-4a4a-9772-a6e3d5212f13 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:35.041207 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1a04e5ea-469a-4a4a-9772-a6e3d5212f13 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:35.041974 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1a04e5ea-469a-4a4a-9772-a6e3d5212f13 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:35.042404 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1a04e5ea-469a-4a4a-9772-a6e3d5212f13 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:35.056349 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-1a04e5ea-469a-4a4a-9772-a6e3d5212f13 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] HTTP exception thrown: Instance 0fc6933f-611e-4adf-84ec-84e9a7fa7c90 could not be found. Jul 15 15:32:35.058040 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1a04e5ea-469a-4a4a-9772-a6e3d5212f13 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Request method failure captured: Jul 15 15:32:35.058040 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 HTTP/1.1 Jul 15 15:32:35.058040 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:32:35.058040 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:32:35.058040 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:32:35.058040 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 15 15:32:35.058040 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:32:35.058040 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:32:35.058040 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:32:35.058040 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:32:35.058040 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0YgxXva7d4EJbVMknInIVXFFvEEyx5W4gafXLIUQQBzoxevSEVrwXon6z9CFmWSIgWM2ggDB48DS2zqhh4613e0tRwyaklMWY86mRnlRcbpd2XTbYm3k6Sk8JIFjIsE5qJpqwRDaOvmfYuZOFoSjLU-PdED6AxXE-L-xrzCMz-WBpzE Jul 15 15:32:35.058040 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:32:35.058040 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:32:35.058040 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:32:35.058040 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:32:35.058040 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:32:35.058040 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:32:35.058040 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: 6fd8c6fef93d4313bb7894175242fd8c Jul 15 15:32:35.058040 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1648674728 Jul 15 15:32:35.058040 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:32:35.058040 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:32:35.059621 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6fd8c6fef93d4313bb7894175242fd8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6fd8c6fef93d4313bb7894175242fd8c", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6fd8c6fef93d4313bb7894175242fd8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6fd8c6fef93d4313bb7894175242fd8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:32:35.059621 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-VolumesSnapshotTestJSON-1648674728 Jul 15 15:32:35.059621 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 6fd8c6fef93d4313bb7894175242fd8c Jul 15 15:32:35.059621 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1648674728 Jul 15 15:32:35.059621 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-VolumesSnapshotTestJSON-1648674728-project Jul 15 15:32:35.059621 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:32:35.059621 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:32:35.059621 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: 28669cdf427a4012a766df06d598e54d Jul 15 15:32:35.059621 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-VolumesSnapshotTestJSON-1648674728-project Jul 15 15:32:35.059621 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: > Jul 15 15:32:35.059621 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Instance 0fc6933f-611e-4adf-84ec-84e9a7fa7c90 could not be found. Jul 15 15:32:35.059621 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'id': '0fc6933f-611e-4adf-84ec-84e9a7fa7c90'} Jul 15 15:32:35.060554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:32:35.060554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:32:35.060554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:32:35.060554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:32:35.060554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:32:35.060554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:32:35.060554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:32:35.060554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:32:35.060554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:32:35.060554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:32:35.060554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fc6933f-611e-4adf-84ec-84e9a7fa7c90 could not be found. Jul 15 15:32:35.060554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:32:35.060554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:32:35.060554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:32:35.060554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:32:35.060554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:32:35.060554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:32:35.060554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:32:35.060554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:32:35.060554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:32:35.061930 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:32:35.061930 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:32:35.061930 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:32:35.061930 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:32:35.061930 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:32:35.061930 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:32:35.061930 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:32:35.061930 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fc6933f-611e-4adf-84ec-84e9a7fa7c90 could not be found. Jul 15 15:32:35.061930 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:32:35.061930 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:32:35.061930 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:32:35.061930 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:32:35.061930 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:32:35.061930 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:32:35.061930 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:32:35.061930 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:32:35.061930 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fc6933f-611e-4adf-84ec-84e9a7fa7c90 could not be found. Jul 15 15:32:35.061930 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:32:35.063774 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1a04e5ea-469a-4a4a-9772-a6e3d5212f13 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Returning 404 to user: Instance 0fc6933f-611e-4adf-84ec-84e9a7fa7c90 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:32:35.063774 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1a04e5ea-469a-4a4a-9772-a6e3d5212f13 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90" status: 404 len: 111 microversion: 2.1 time: 0.033030 Jul 15 15:32:35.063774 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 272/540] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:35 2022] GET /compute/v2.1/servers/0fc6933f-611e-4adf-84ec-84e9a7fa7c90 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:32:35.198761 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-56df61c7-6f80-4436-86c5-2ed63b21d436 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:35.207829 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-56df61c7-6f80-4436-86c5-2ed63b21d436 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:35.209363 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-56df61c7-6f80-4436-86c5-2ed63b21d436 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:35.210571 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-56df61c7-6f80-4436-86c5-2ed63b21d436 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.186835 Jul 15 15:32:35.211175 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 269/541] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:35 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:35.563404 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4495baaa-e15a-4e56-b76e-4ae5e92a9eed tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6373bd49-176a-477f-b54c-32e42dac79fd"}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:32:35.564465 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-4495baaa-e15a-4e56-b76e-4ae5e92a9eed tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:35.570650 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4495baaa-e15a-4e56-b76e-4ae5e92a9eed tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:35.571094 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4495baaa-e15a-4e56-b76e-4ae5e92a9eed tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:35.571877 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4495baaa-e15a-4e56-b76e-4ae5e92a9eed tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:35.572308 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4495baaa-e15a-4e56-b76e-4ae5e92a9eed tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:35.861451 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4495baaa-e15a-4e56-b76e-4ae5e92a9eed tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "POST /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.406391 Jul 15 15:32:35.862053 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 273/542] 10.222.0.40 () {60 vars in 1322 bytes} [Fri Jul 15 15:32:35 2022] POST /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8/os-volume_attachments => generated 194 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:32:36.230437 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-b1dba5a7-9aa8-431f-805c-de5a52285a8b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:36.231125 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-b1dba5a7-9aa8-431f-805c-de5a52285a8b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:36.238079 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b1dba5a7-9aa8-431f-805c-de5a52285a8b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:36.238546 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b1dba5a7-9aa8-431f-805c-de5a52285a8b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:36.239303 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b1dba5a7-9aa8-431f-805c-de5a52285a8b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:36.239732 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b1dba5a7-9aa8-431f-805c-de5a52285a8b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:36.382757 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b1dba5a7-9aa8-431f-805c-de5a52285a8b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:36.392036 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b1dba5a7-9aa8-431f-805c-de5a52285a8b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:36.393522 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b1dba5a7-9aa8-431f-805c-de5a52285a8b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:36.394728 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-b1dba5a7-9aa8-431f-805c-de5a52285a8b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.168670 Jul 15 15:32:36.395259 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 270/543] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:36 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:37.414794 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e1907dc8-226c-4fa3-8cf0-653b75b9ef03 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:37.415454 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e1907dc8-226c-4fa3-8cf0-653b75b9ef03 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:37.422396 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e1907dc8-226c-4fa3-8cf0-653b75b9ef03 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:37.422871 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e1907dc8-226c-4fa3-8cf0-653b75b9ef03 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:37.423668 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e1907dc8-226c-4fa3-8cf0-653b75b9ef03 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:37.424099 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e1907dc8-226c-4fa3-8cf0-653b75b9ef03 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:37.563984 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e1907dc8-226c-4fa3-8cf0-653b75b9ef03 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:37.572997 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e1907dc8-226c-4fa3-8cf0-653b75b9ef03 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:37.574427 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e1907dc8-226c-4fa3-8cf0-653b75b9ef03 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:37.575614 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e1907dc8-226c-4fa3-8cf0-653b75b9ef03 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.166120 Jul 15 15:32:37.576185 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 274/544] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:37 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:38.594915 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-ef71c371-6940-4b1e-8250-c2d3afbe0ef7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:38.595509 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-ef71c371-6940-4b1e-8250-c2d3afbe0ef7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:38.602266 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ef71c371-6940-4b1e-8250-c2d3afbe0ef7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:38.602739 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ef71c371-6940-4b1e-8250-c2d3afbe0ef7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:38.603482 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ef71c371-6940-4b1e-8250-c2d3afbe0ef7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:38.603904 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ef71c371-6940-4b1e-8250-c2d3afbe0ef7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:38.750135 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-ef71c371-6940-4b1e-8250-c2d3afbe0ef7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:38.759365 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-ef71c371-6940-4b1e-8250-c2d3afbe0ef7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:38.760879 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-ef71c371-6940-4b1e-8250-c2d3afbe0ef7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:38.762239 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-ef71c371-6940-4b1e-8250-c2d3afbe0ef7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.171259 Jul 15 15:32:38.762583 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 271/545] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:38 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:39.781058 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-93277010-259e-4acd-91e9-c04c8ce1b885 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:39.781605 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-93277010-259e-4acd-91e9-c04c8ce1b885 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:39.789140 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-93277010-259e-4acd-91e9-c04c8ce1b885 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:39.789597 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-93277010-259e-4acd-91e9-c04c8ce1b885 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:39.790330 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-93277010-259e-4acd-91e9-c04c8ce1b885 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:39.790817 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-93277010-259e-4acd-91e9-c04c8ce1b885 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:39.927406 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-93277010-259e-4acd-91e9-c04c8ce1b885 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:39.936459 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-93277010-259e-4acd-91e9-c04c8ce1b885 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:39.937975 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-93277010-259e-4acd-91e9-c04c8ce1b885 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:39.939169 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-93277010-259e-4acd-91e9-c04c8ce1b885 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.162437 Jul 15 15:32:39.939728 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 275/546] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:39 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:40.959288 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3df7ad39-f756-4cd1-bda2-b10fa3bcc993 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:40.959907 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-3df7ad39-f756-4cd1-bda2-b10fa3bcc993 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:40.967666 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3df7ad39-f756-4cd1-bda2-b10fa3bcc993 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:40.968550 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3df7ad39-f756-4cd1-bda2-b10fa3bcc993 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:40.970034 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3df7ad39-f756-4cd1-bda2-b10fa3bcc993 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:40.970475 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3df7ad39-f756-4cd1-bda2-b10fa3bcc993 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:41.116149 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3df7ad39-f756-4cd1-bda2-b10fa3bcc993 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:41.125412 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3df7ad39-f756-4cd1-bda2-b10fa3bcc993 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:41.126933 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3df7ad39-f756-4cd1-bda2-b10fa3bcc993 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:41.128151 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-3df7ad39-f756-4cd1-bda2-b10fa3bcc993 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.174307 Jul 15 15:32:41.128685 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 272/547] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:40 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:32:42.146888 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ee4aa8e4-99f0-4511-b2bb-33e836175c05 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:42.147473 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ee4aa8e4-99f0-4511-b2bb-33e836175c05 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:42.154183 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ee4aa8e4-99f0-4511-b2bb-33e836175c05 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:42.154666 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ee4aa8e4-99f0-4511-b2bb-33e836175c05 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:42.155425 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ee4aa8e4-99f0-4511-b2bb-33e836175c05 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:42.155864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ee4aa8e4-99f0-4511-b2bb-33e836175c05 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:42.291742 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ee4aa8e4-99f0-4511-b2bb-33e836175c05 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:42.300444 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ee4aa8e4-99f0-4511-b2bb-33e836175c05 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:42.301955 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ee4aa8e4-99f0-4511-b2bb-33e836175c05 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:42.303160 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ee4aa8e4-99f0-4511-b2bb-33e836175c05 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.160359 Jul 15 15:32:42.303716 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 276/548] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:42 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:43.321611 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-c6358072-b3a5-4953-ab9c-93199434124b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:43.322212 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-c6358072-b3a5-4953-ab9c-93199434124b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:43.329199 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c6358072-b3a5-4953-ab9c-93199434124b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:43.329648 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c6358072-b3a5-4953-ab9c-93199434124b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:43.330421 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c6358072-b3a5-4953-ab9c-93199434124b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:43.330965 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c6358072-b3a5-4953-ab9c-93199434124b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:43.465073 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-c6358072-b3a5-4953-ab9c-93199434124b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:43.473925 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-c6358072-b3a5-4953-ab9c-93199434124b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:43.475474 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-c6358072-b3a5-4953-ab9c-93199434124b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:43.476944 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-c6358072-b3a5-4953-ab9c-93199434124b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.159496 Jul 15 15:32:43.477502 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 273/549] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:43 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:44.496821 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-930d688d-65d8-47c4-81bb-ec9fbcf122b6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:44.497501 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-930d688d-65d8-47c4-81bb-ec9fbcf122b6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:44.504658 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-930d688d-65d8-47c4-81bb-ec9fbcf122b6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:44.505102 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-930d688d-65d8-47c4-81bb-ec9fbcf122b6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:44.505862 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-930d688d-65d8-47c4-81bb-ec9fbcf122b6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:44.506267 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-930d688d-65d8-47c4-81bb-ec9fbcf122b6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:44.650114 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-930d688d-65d8-47c4-81bb-ec9fbcf122b6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:44.658796 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-930d688d-65d8-47c4-81bb-ec9fbcf122b6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:44.660290 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-930d688d-65d8-47c4-81bb-ec9fbcf122b6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:44.661528 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-930d688d-65d8-47c4-81bb-ec9fbcf122b6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.169523 Jul 15 15:32:44.662096 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 277/550] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:44 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:45.682761 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-1afde3ce-70fe-4873-82e0-e62fde3ffc0d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:45.683658 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-1afde3ce-70fe-4873-82e0-e62fde3ffc0d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:45.694075 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1afde3ce-70fe-4873-82e0-e62fde3ffc0d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:45.694902 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1afde3ce-70fe-4873-82e0-e62fde3ffc0d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:45.696427 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1afde3ce-70fe-4873-82e0-e62fde3ffc0d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:45.697060 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1afde3ce-70fe-4873-82e0-e62fde3ffc0d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:45.845732 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1afde3ce-70fe-4873-82e0-e62fde3ffc0d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:45.856244 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1afde3ce-70fe-4873-82e0-e62fde3ffc0d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:45.857735 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1afde3ce-70fe-4873-82e0-e62fde3ffc0d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:45.859073 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-1afde3ce-70fe-4873-82e0-e62fde3ffc0d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.181652 Jul 15 15:32:45.859641 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 274/551] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:45 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:46.880356 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-103236ae-ae8b-476b-b193-44028a044f5a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:46.881350 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-103236ae-ae8b-476b-b193-44028a044f5a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:46.890112 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-103236ae-ae8b-476b-b193-44028a044f5a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:46.890631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-103236ae-ae8b-476b-b193-44028a044f5a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:46.891399 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-103236ae-ae8b-476b-b193-44028a044f5a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:46.891884 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-103236ae-ae8b-476b-b193-44028a044f5a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:47.062363 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-103236ae-ae8b-476b-b193-44028a044f5a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:47.071568 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-103236ae-ae8b-476b-b193-44028a044f5a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:47.073228 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-103236ae-ae8b-476b-b193-44028a044f5a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:47.074553 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-103236ae-ae8b-476b-b193-44028a044f5a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.200077 Jul 15 15:32:47.075176 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 278/552] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:46 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:47.083124 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-451356e3-e5c1-416f-a06d-92151061c27d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1620392886", "imageRef": "b9770891-ef3b-4f53-a989-3a4db420d5c5", "flavorRef": "452", "networks": [{"uuid": "46a06aa9-e236-455a-a5e0-dcd3c94c9bb2"}]}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:32:47.137542 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.network.neutron [None req-451356e3-e5c1-416f-a06d-92151061c27d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] validate_networks() for [('46a06aa9-e236-455a-a5e0-dcd3c94c9bb2', None, None, None, None, None)] {{(pid=117999) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:32:47.529726 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-451356e3-e5c1-416f-a06d-92151061c27d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Flavor limits 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:32:47.530356 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-451356e3-e5c1-416f-a06d-92151061c27d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Image limits 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:32:47.531157 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-451356e3-e5c1-416f-a06d-92151061c27d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Flavor pref 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:32:47.531605 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-451356e3-e5c1-416f-a06d-92151061c27d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Image pref 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:32:47.532241 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-451356e3-e5c1-416f-a06d-92151061c27d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:32:47.545312 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-451356e3-e5c1-416f-a06d-92151061c27d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:47.545599 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-451356e3-e5c1-416f-a06d-92151061c27d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:47.546442 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-451356e3-e5c1-416f-a06d-92151061c27d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:47.547217 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-451356e3-e5c1-416f-a06d-92151061c27d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:47.553945 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=100 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:47.570825 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-451356e3-e5c1-416f-a06d-92151061c27d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Getting quotas for project 6fd8c6fef93d4313bb7894175242fd8c. Resources: {'ram', 'instances', 'cores'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:32:47.577810 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-451356e3-e5c1-416f-a06d-92151061c27d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Getting quotas for user 28669cdf427a4012a766df06d598e54d and project 6fd8c6fef93d4313bb7894175242fd8c. Resources: {'ram', 'instances', 'cores'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:32:47.594173 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-451356e3-e5c1-416f-a06d-92151061c27d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Going to run 1 instances... {{(pid=117999) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:32:47.596564 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-451356e3-e5c1-416f-a06d-92151061c27d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 03818957-84f5-4de2-8524-06ac54544f52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9770891-ef3b-4f53-a989-3a4db420d5c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117999) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:32:47.645479 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-451356e3-e5c1-416f-a06d-92151061c27d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566094 Jul 15 15:32:47.646156 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 275/553] 10.222.0.40 () {60 vars in 1146 bytes} [Fri Jul 15 15:32:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 15 15:32:47.661180 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f78d39c8-7e62-4223-ba68-3c70293a42e1 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:47.662217 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f78d39c8-7e62-4223-ba68-3c70293a42e1 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 03818957-84f5-4de2-8524-06ac54544f52] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:47.733744 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f78d39c8-7e62-4223-ba68-3c70293a42e1 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:47.741461 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f78d39c8-7e62-4223-ba68-3c70293a42e1 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52" status: 200 len: 1219 microversion: 2.1 time: 0.087584 Jul 15 15:32:47.742229 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 279/554] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:47 2022] GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:32:48.095135 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-67de8f43-b7b3-42f4-8495-bd9fa678d438 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:48.095772 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-67de8f43-b7b3-42f4-8495-bd9fa678d438 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:48.103220 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-67de8f43-b7b3-42f4-8495-bd9fa678d438 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:48.103649 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-67de8f43-b7b3-42f4-8495-bd9fa678d438 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:48.104420 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-67de8f43-b7b3-42f4-8495-bd9fa678d438 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:48.104839 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-67de8f43-b7b3-42f4-8495-bd9fa678d438 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:48.288079 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-67de8f43-b7b3-42f4-8495-bd9fa678d438 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:48.298887 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-67de8f43-b7b3-42f4-8495-bd9fa678d438 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:48.302909 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-67de8f43-b7b3-42f4-8495-bd9fa678d438 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:48.304236 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-67de8f43-b7b3-42f4-8495-bd9fa678d438 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.213516 Jul 15 15:32:48.305224 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 276/555] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:48 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:48.581516 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-f9273b0b-cce1-4989-88fd-18210d74d067 req-e1ec5415-e836-44a4-aaaf-968764056410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5180ff6f-38fa-49c2-9663-9269dcae4849", "name": "network-vif-plugged", "status": "completed", "tag": "03d3bd84-1aa5-4842-b751-250a289b02fe"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:32:48.601933 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-f9273b0b-cce1-4989-88fd-18210d74d067 req-e1ec5415-e836-44a4-aaaf-968764056410 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:48.603587 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-f9273b0b-cce1-4989-88fd-18210d74d067 req-e1ec5415-e836-44a4-aaaf-968764056410 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:48.620614 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-f9273b0b-cce1-4989-88fd-18210d74d067 req-e1ec5415-e836-44a4-aaaf-968764056410 service nova] Creating event network-vif-plugged:03d3bd84-1aa5-4842-b751-250a289b02fe for instance 5180ff6f-38fa-49c2-9663-9269dcae4849 on hv-cinder-85001 Jul 15 15:32:48.628365 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-f9273b0b-cce1-4989-88fd-18210d74d067 req-e1ec5415-e836-44a4-aaaf-968764056410 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125885 Jul 15 15:32:48.629197 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 280/556] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:32:48.702182 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-c260e41f-fd62-4c4d-9170-40efce26a4f0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:32:48.703290 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-c260e41f-fd62-4c4d-9170-40efce26a4f0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:48.709833 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c260e41f-fd62-4c4d-9170-40efce26a4f0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:48.710636 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c260e41f-fd62-4c4d-9170-40efce26a4f0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:48.711412 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c260e41f-fd62-4c4d-9170-40efce26a4f0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:48.712009 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c260e41f-fd62-4c4d-9170-40efce26a4f0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:48.737760 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.objects.instance [None req-c260e41f-fd62-4c4d-9170-40efce26a4f0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lazy-loading 'flavor' on Instance uuid 5eead4bb-c878-4229-b3fc-85f35ec8c5f8 {{(pid=117999) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:32:48.760714 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b2df143e-197c-4549-bb70-094a5f5b1be4 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:48.761433 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b2df143e-197c-4549-bb70-094a5f5b1be4 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 03818957-84f5-4de2-8524-06ac54544f52] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:48.769040 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b2df143e-197c-4549-bb70-094a5f5b1be4 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:48.769820 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b2df143e-197c-4549-bb70-094a5f5b1be4 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:48.770790 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b2df143e-197c-4549-bb70-094a5f5b1be4 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:48.771232 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b2df143e-197c-4549-bb70-094a5f5b1be4 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:48.844584 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b2df143e-197c-4549-bb70-094a5f5b1be4 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:48.854356 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b2df143e-197c-4549-bb70-094a5f5b1be4 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52" status: 200 len: 1279 microversion: 2.1 time: 0.098075 Jul 15 15:32:48.855370 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 281/557] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:48 2022] GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52 => generated 1279 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:32:48.936814 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-c260e41f-fd62-4c4d-9170-40efce26a4f0 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "POST /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8/action" status: 200 len: 32 microversion: 2.1 time: 0.240080 Jul 15 15:32:48.937809 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 277/558] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 15 15:32:48 2022] POST /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8/action => generated 32 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 15:32:48.947567 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2bd3d26b-e77c-4d96-9367-9c37998a1449 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:48.948178 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-2bd3d26b-e77c-4d96-9367-9c37998a1449 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:48.954920 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2bd3d26b-e77c-4d96-9367-9c37998a1449 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:48.955366 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2bd3d26b-e77c-4d96-9367-9c37998a1449 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:48.956138 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2bd3d26b-e77c-4d96-9367-9c37998a1449 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:48.956570 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2bd3d26b-e77c-4d96-9367-9c37998a1449 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:49.105846 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2bd3d26b-e77c-4d96-9367-9c37998a1449 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:49.120801 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-2bd3d26b-e77c-4d96-9367-9c37998a1449 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1737 microversion: 2.1 time: 0.177148 Jul 15 15:32:49.122230 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 282/559] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:48 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:32:49.326403 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-4d687b97-b12c-4a02-8668-c41ef581cb25 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:49.327899 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-4d687b97-b12c-4a02-8668-c41ef581cb25 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:49.339942 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4d687b97-b12c-4a02-8668-c41ef581cb25 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:49.340111 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4d687b97-b12c-4a02-8668-c41ef581cb25 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:49.341225 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4d687b97-b12c-4a02-8668-c41ef581cb25 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:49.341470 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4d687b97-b12c-4a02-8668-c41ef581cb25 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:49.594249 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-4d687b97-b12c-4a02-8668-c41ef581cb25 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:49.603507 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-4d687b97-b12c-4a02-8668-c41ef581cb25 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:49.605024 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-4d687b97-b12c-4a02-8668-c41ef581cb25 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:49.606173 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-4d687b97-b12c-4a02-8668-c41ef581cb25 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.287028 Jul 15 15:32:49.606757 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 278/560] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:49 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:49.873403 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b9f2efff-7d0e-4fd2-a121-8afe6d40fd77 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:49.873976 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b9f2efff-7d0e-4fd2-a121-8afe6d40fd77 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 03818957-84f5-4de2-8524-06ac54544f52] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:49.881149 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b9f2efff-7d0e-4fd2-a121-8afe6d40fd77 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:49.881695 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b9f2efff-7d0e-4fd2-a121-8afe6d40fd77 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:49.882473 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b9f2efff-7d0e-4fd2-a121-8afe6d40fd77 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:49.882932 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b9f2efff-7d0e-4fd2-a121-8afe6d40fd77 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:49.992191 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b9f2efff-7d0e-4fd2-a121-8afe6d40fd77 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:50.001438 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b9f2efff-7d0e-4fd2-a121-8afe6d40fd77 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52" status: 200 len: 1277 microversion: 2.1 time: 0.132449 Jul 15 15:32:50.002610 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 283/561] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:49 2022] GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52 => generated 1277 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:32:50.148048 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-dd1d3846-5e3a-4f53-9e8f-5c7c9f9ddee3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:50.149187 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-dd1d3846-5e3a-4f53-9e8f-5c7c9f9ddee3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:50.156175 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-dd1d3846-5e3a-4f53-9e8f-5c7c9f9ddee3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:50.156708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-dd1d3846-5e3a-4f53-9e8f-5c7c9f9ddee3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:50.157546 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-dd1d3846-5e3a-4f53-9e8f-5c7c9f9ddee3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:50.158069 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-dd1d3846-5e3a-4f53-9e8f-5c7c9f9ddee3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:50.619345 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-dd1d3846-5e3a-4f53-9e8f-5c7c9f9ddee3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:50.625797 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-df81b541-178a-4d1c-9ed6-3fe246485cd4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:50.626423 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-df81b541-178a-4d1c-9ed6-3fe246485cd4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:50.632661 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-df81b541-178a-4d1c-9ed6-3fe246485cd4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:50.633153 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-df81b541-178a-4d1c-9ed6-3fe246485cd4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:50.633924 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-df81b541-178a-4d1c-9ed6-3fe246485cd4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:50.634447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-df81b541-178a-4d1c-9ed6-3fe246485cd4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:50.635075 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-dd1d3846-5e3a-4f53-9e8f-5c7c9f9ddee3 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1737 microversion: 2.1 time: 0.494051 Jul 15 15:32:50.635678 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 279/562] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:50 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1737 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:32:50.798896 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-df81b541-178a-4d1c-9ed6-3fe246485cd4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:50.808623 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-df81b541-178a-4d1c-9ed6-3fe246485cd4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:50.810127 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-df81b541-178a-4d1c-9ed6-3fe246485cd4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:50.811327 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-df81b541-178a-4d1c-9ed6-3fe246485cd4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.189517 Jul 15 15:32:50.811899 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 284/563] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:50 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:32:51.022807 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-428d455f-ce51-4d98-b581-7c9baf801a65 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:51.023419 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-428d455f-ce51-4d98-b581-7c9baf801a65 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 03818957-84f5-4de2-8524-06ac54544f52] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:51.030423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-428d455f-ce51-4d98-b581-7c9baf801a65 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:51.030896 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-428d455f-ce51-4d98-b581-7c9baf801a65 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:51.031672 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-428d455f-ce51-4d98-b581-7c9baf801a65 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:51.032098 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-428d455f-ce51-4d98-b581-7c9baf801a65 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:51.418196 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-428d455f-ce51-4d98-b581-7c9baf801a65 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:51.437264 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-428d455f-ce51-4d98-b581-7c9baf801a65 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52" status: 200 len: 1319 microversion: 2.1 time: 0.418312 Jul 15 15:32:51.442664 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 280/564] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:51 2022] GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52 => generated 1319 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:32:51.659708 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ffc8f463-984e-4f82-a71b-5e95f62a2e96 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:51.660485 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ffc8f463-984e-4f82-a71b-5e95f62a2e96 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:51.673317 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ffc8f463-984e-4f82-a71b-5e95f62a2e96 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:51.675819 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ffc8f463-984e-4f82-a71b-5e95f62a2e96 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:51.676966 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ffc8f463-984e-4f82-a71b-5e95f62a2e96 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:51.677469 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ffc8f463-984e-4f82-a71b-5e95f62a2e96 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:51.839793 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-bdc05ffa-daaa-4d4f-a42e-05fc43a07252 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:51.841772 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-bdc05ffa-daaa-4d4f-a42e-05fc43a07252 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:51.850035 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bdc05ffa-daaa-4d4f-a42e-05fc43a07252 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:51.850995 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bdc05ffa-daaa-4d4f-a42e-05fc43a07252 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:51.852071 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bdc05ffa-daaa-4d4f-a42e-05fc43a07252 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:51.853010 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bdc05ffa-daaa-4d4f-a42e-05fc43a07252 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:51.990454 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ffc8f463-984e-4f82-a71b-5e95f62a2e96 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:52.000210 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ffc8f463-984e-4f82-a71b-5e95f62a2e96 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1737 microversion: 2.1 time: 0.345495 Jul 15 15:32:52.001220 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 285/565] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:51 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1737 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:32:52.005538 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-2b614428-499f-41a3-9f82-ddfff58469f3 req-2744b06c-616d-4523-877c-7625dfdbb4ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03818957-84f5-4de2-8524-06ac54544f52", "tag": "8cd2e28a-b15f-4af5-b088-891272292666"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:32:52.015828 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-2b614428-499f-41a3-9f82-ddfff58469f3 req-2744b06c-616d-4523-877c-7625dfdbb4ba service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:52.016290 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-2b614428-499f-41a3-9f82-ddfff58469f3 req-2744b06c-616d-4523-877c-7625dfdbb4ba service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:52.029312 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-2b614428-499f-41a3-9f82-ddfff58469f3 req-2744b06c-616d-4523-877c-7625dfdbb4ba service nova] Creating event network-changed:8cd2e28a-b15f-4af5-b088-891272292666 for instance 03818957-84f5-4de2-8524-06ac54544f52 on hv-cinder-85001 Jul 15 15:32:52.035701 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-2b614428-499f-41a3-9f82-ddfff58469f3 req-2744b06c-616d-4523-877c-7625dfdbb4ba service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033535 Jul 15 15:32:52.036974 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 286/566] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:32:52.107139 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-bdc05ffa-daaa-4d4f-a42e-05fc43a07252 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:52.121424 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-bdc05ffa-daaa-4d4f-a42e-05fc43a07252 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:52.123311 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-bdc05ffa-daaa-4d4f-a42e-05fc43a07252 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:52.124767 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-bdc05ffa-daaa-4d4f-a42e-05fc43a07252 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1808 microversion: 2.20 time: 0.294569 Jul 15 15:32:52.125334 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 281/567] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:51 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1808 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:52.457465 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-442b4b37-8396-40d4-982b-b2247c732bb6 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:52.458330 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-442b4b37-8396-40d4-982b-b2247c732bb6 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 03818957-84f5-4de2-8524-06ac54544f52] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:52.464987 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-442b4b37-8396-40d4-982b-b2247c732bb6 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:52.465508 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-442b4b37-8396-40d4-982b-b2247c732bb6 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:52.466498 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-442b4b37-8396-40d4-982b-b2247c732bb6 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:52.468167 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-442b4b37-8396-40d4-982b-b2247c732bb6 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:52.650993 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-442b4b37-8396-40d4-982b-b2247c732bb6 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:52.658554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-442b4b37-8396-40d4-982b-b2247c732bb6 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52" status: 200 len: 1319 microversion: 2.1 time: 0.205389 Jul 15 15:32:52.659117 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 287/568] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:52 2022] GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:32:53.021257 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-31337cb2-a048-400f-a8c7-ddabd6b5ac4c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:53.021843 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-31337cb2-a048-400f-a8c7-ddabd6b5ac4c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:53.029068 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-31337cb2-a048-400f-a8c7-ddabd6b5ac4c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:53.029495 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-31337cb2-a048-400f-a8c7-ddabd6b5ac4c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:53.030265 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-31337cb2-a048-400f-a8c7-ddabd6b5ac4c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:53.030726 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-31337cb2-a048-400f-a8c7-ddabd6b5ac4c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:53.152206 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ec2c7ed3-13e0-4209-a91f-0ae050b3af16 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:53.152872 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ec2c7ed3-13e0-4209-a91f-0ae050b3af16 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:53.163522 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ec2c7ed3-13e0-4209-a91f-0ae050b3af16 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:53.163522 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ec2c7ed3-13e0-4209-a91f-0ae050b3af16 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:53.163522 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ec2c7ed3-13e0-4209-a91f-0ae050b3af16 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:53.163522 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ec2c7ed3-13e0-4209-a91f-0ae050b3af16 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:53.170810 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:53.185037 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-31337cb2-a048-400f-a8c7-ddabd6b5ac4c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:53.193934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-31337cb2-a048-400f-a8c7-ddabd6b5ac4c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1737 microversion: 2.1 time: 0.176559 Jul 15 15:32:53.194552 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 282/569] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:53 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:32:53.325442 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ec2c7ed3-13e0-4209-a91f-0ae050b3af16 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:53.334606 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ec2c7ed3-13e0-4209-a91f-0ae050b3af16 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:53.336136 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ec2c7ed3-13e0-4209-a91f-0ae050b3af16 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:53.337771 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ec2c7ed3-13e0-4209-a91f-0ae050b3af16 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1795 microversion: 2.20 time: 0.191161 Jul 15 15:32:53.339314 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 288/570] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:32:53 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1795 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:32:53.679862 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-10714e22-b446-479d-a644-4693fe949025 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:53.680666 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-10714e22-b446-479d-a644-4693fe949025 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 03818957-84f5-4de2-8524-06ac54544f52] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:53.690887 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-10714e22-b446-479d-a644-4693fe949025 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:53.691436 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-10714e22-b446-479d-a644-4693fe949025 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:53.692771 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-10714e22-b446-479d-a644-4693fe949025 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:53.693413 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-10714e22-b446-479d-a644-4693fe949025 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:53.850261 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-10714e22-b446-479d-a644-4693fe949025 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:53.863465 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-10714e22-b446-479d-a644-4693fe949025 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52" status: 200 len: 1319 microversion: 2.1 time: 0.190450 Jul 15 15:32:53.864094 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 283/571] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:53 2022] GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:32:54.211779 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-595c6139-f82a-45ef-bdfa-094775c13ce8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:54.212402 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-595c6139-f82a-45ef-bdfa-094775c13ce8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:54.219280 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-595c6139-f82a-45ef-bdfa-094775c13ce8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:54.219716 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-595c6139-f82a-45ef-bdfa-094775c13ce8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:54.220485 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-595c6139-f82a-45ef-bdfa-094775c13ce8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:54.220916 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-595c6139-f82a-45ef-bdfa-094775c13ce8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:54.360262 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-595c6139-f82a-45ef-bdfa-094775c13ce8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:54.369354 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-595c6139-f82a-45ef-bdfa-094775c13ce8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1737 microversion: 2.1 time: 0.162126 Jul 15 15:32:54.370307 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 289/572] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:54 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:32:54.882240 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3153a53a-207c-432e-a208-b59dc62bf806 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:54.883421 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-3153a53a-207c-432e-a208-b59dc62bf806 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 03818957-84f5-4de2-8524-06ac54544f52] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:54.891355 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3153a53a-207c-432e-a208-b59dc62bf806 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:54.891783 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3153a53a-207c-432e-a208-b59dc62bf806 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:54.892541 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3153a53a-207c-432e-a208-b59dc62bf806 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:54.892964 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3153a53a-207c-432e-a208-b59dc62bf806 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:55.049250 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3153a53a-207c-432e-a208-b59dc62bf806 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:55.057957 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-3153a53a-207c-432e-a208-b59dc62bf806 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52" status: 200 len: 1319 microversion: 2.1 time: 0.179958 Jul 15 15:32:55.058732 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 284/573] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:54 2022] GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:32:55.390852 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a23cb658-1de3-4243-8b10-f0041aeea515 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:55.391829 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a23cb658-1de3-4243-8b10-f0041aeea515 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:55.402696 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a23cb658-1de3-4243-8b10-f0041aeea515 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:55.403461 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a23cb658-1de3-4243-8b10-f0041aeea515 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:55.404777 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a23cb658-1de3-4243-8b10-f0041aeea515 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:55.405534 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a23cb658-1de3-4243-8b10-f0041aeea515 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:55.571095 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a23cb658-1de3-4243-8b10-f0041aeea515 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:55.581159 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a23cb658-1de3-4243-8b10-f0041aeea515 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1737 microversion: 2.1 time: 0.196344 Jul 15 15:32:55.582041 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 290/574] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:55 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:32:56.075607 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-0b410120-4e4c-4565-8b2d-e98be0584299 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:56.076253 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-0b410120-4e4c-4565-8b2d-e98be0584299 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 03818957-84f5-4de2-8524-06ac54544f52] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:56.083756 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0b410120-4e4c-4565-8b2d-e98be0584299 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:56.084178 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0b410120-4e4c-4565-8b2d-e98be0584299 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:56.084984 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0b410120-4e4c-4565-8b2d-e98be0584299 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:56.085419 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0b410120-4e4c-4565-8b2d-e98be0584299 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:56.262276 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-0b410120-4e4c-4565-8b2d-e98be0584299 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:56.272298 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-0b410120-4e4c-4565-8b2d-e98be0584299 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52" status: 200 len: 1319 microversion: 2.1 time: 0.200510 Jul 15 15:32:56.272886 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 285/575] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:56 2022] GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:32:56.600807 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0918a634-2362-4f31-a3b2-578405aecbe9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:56.601560 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-0918a634-2362-4f31-a3b2-578405aecbe9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:56.608902 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0918a634-2362-4f31-a3b2-578405aecbe9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:56.609328 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0918a634-2362-4f31-a3b2-578405aecbe9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:56.610144 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0918a634-2362-4f31-a3b2-578405aecbe9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:56.610586 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0918a634-2362-4f31-a3b2-578405aecbe9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:56.771061 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0918a634-2362-4f31-a3b2-578405aecbe9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:56.780777 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-0918a634-2362-4f31-a3b2-578405aecbe9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1737 microversion: 2.1 time: 0.184115 Jul 15 15:32:56.781423 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 291/576] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:56 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:32:57.295336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-b7548cee-5d94-4261-99f1-9c9f0f618875 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:57.296342 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-b7548cee-5d94-4261-99f1-9c9f0f618875 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 03818957-84f5-4de2-8524-06ac54544f52] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:57.302740 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b7548cee-5d94-4261-99f1-9c9f0f618875 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:57.303185 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b7548cee-5d94-4261-99f1-9c9f0f618875 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:57.303952 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b7548cee-5d94-4261-99f1-9c9f0f618875 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:57.304545 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b7548cee-5d94-4261-99f1-9c9f0f618875 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:57.449897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b7548cee-5d94-4261-99f1-9c9f0f618875 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:57.457766 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-b7548cee-5d94-4261-99f1-9c9f0f618875 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52" status: 200 len: 1319 microversion: 2.1 time: 0.166417 Jul 15 15:32:57.459270 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 286/577] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:57 2022] GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:32:57.799533 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c4a130ea-4b24-4dab-b595-8b9404c86af8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:57.800222 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-c4a130ea-4b24-4dab-b595-8b9404c86af8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:57.802653 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:57.808679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c4a130ea-4b24-4dab-b595-8b9404c86af8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:57.809119 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c4a130ea-4b24-4dab-b595-8b9404c86af8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:57.809876 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c4a130ea-4b24-4dab-b595-8b9404c86af8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:57.810299 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c4a130ea-4b24-4dab-b595-8b9404c86af8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:57.947921 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c4a130ea-4b24-4dab-b595-8b9404c86af8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:57.959961 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-c4a130ea-4b24-4dab-b595-8b9404c86af8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1737 microversion: 2.1 time: 0.164351 Jul 15 15:32:57.960587 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 292/578] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:57 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:32:58.472952 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=2 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:58.473764 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=6 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:58.479760 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-9ed5c4bf-a36d-4e7c-abbc-0e7f70002ef0 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:58.480601 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-9ed5c4bf-a36d-4e7c-abbc-0e7f70002ef0 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 03818957-84f5-4de2-8524-06ac54544f52] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:58.488915 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9ed5c4bf-a36d-4e7c-abbc-0e7f70002ef0 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:58.489731 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9ed5c4bf-a36d-4e7c-abbc-0e7f70002ef0 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:58.490561 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9ed5c4bf-a36d-4e7c-abbc-0e7f70002ef0 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:58.491447 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9ed5c4bf-a36d-4e7c-abbc-0e7f70002ef0 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:58.656366 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-9ed5c4bf-a36d-4e7c-abbc-0e7f70002ef0 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:58.672625 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-9ed5c4bf-a36d-4e7c-abbc-0e7f70002ef0 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52" status: 200 len: 1319 microversion: 2.1 time: 0.200624 Jul 15 15:32:58.673227 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 287/579] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:58 2022] GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:32:58.980005 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f1dc2b45-3108-4d46-818f-8ccd18cb4de4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:58.980619 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f1dc2b45-3108-4d46-818f-8ccd18cb4de4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:58.988669 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f1dc2b45-3108-4d46-818f-8ccd18cb4de4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:58.989104 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f1dc2b45-3108-4d46-818f-8ccd18cb4de4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:58.989871 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f1dc2b45-3108-4d46-818f-8ccd18cb4de4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:58.990291 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f1dc2b45-3108-4d46-818f-8ccd18cb4de4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:59.159088 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f1dc2b45-3108-4d46-818f-8ccd18cb4de4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:59.177795 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f1dc2b45-3108-4d46-818f-8ccd18cb4de4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1737 microversion: 2.1 time: 0.201986 Jul 15 15:32:59.178393 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 293/580] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:58 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1737 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:32:59.690171 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-fac21607-e6c2-4db1-9852-51d601b5b88f tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:32:59.690762 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-fac21607-e6c2-4db1-9852-51d601b5b88f tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 03818957-84f5-4de2-8524-06ac54544f52] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:32:59.697497 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fac21607-e6c2-4db1-9852-51d601b5b88f tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:59.697943 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fac21607-e6c2-4db1-9852-51d601b5b88f tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:59.698752 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fac21607-e6c2-4db1-9852-51d601b5b88f tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:32:59.699183 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fac21607-e6c2-4db1-9852-51d601b5b88f tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:32:59.859002 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-fac21607-e6c2-4db1-9852-51d601b5b88f tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:32:59.869921 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-fac21607-e6c2-4db1-9852-51d601b5b88f tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52" status: 200 len: 1319 microversion: 2.1 time: 0.183368 Jul 15 15:32:59.870495 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 288/581] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:32:59 2022] GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:00.198294 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0f84d512-5b35-4746-a790-d3fdd605c15c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:00.199263 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-0f84d512-5b35-4746-a790-d3fdd605c15c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:00.206285 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0f84d512-5b35-4746-a790-d3fdd605c15c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:00.206763 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0f84d512-5b35-4746-a790-d3fdd605c15c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:00.207521 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0f84d512-5b35-4746-a790-d3fdd605c15c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:00.207947 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0f84d512-5b35-4746-a790-d3fdd605c15c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:00.360725 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0f84d512-5b35-4746-a790-d3fdd605c15c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:00.370552 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-0f84d512-5b35-4746-a790-d3fdd605c15c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1737 microversion: 2.1 time: 0.176450 Jul 15 15:33:00.371016 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 294/582] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:00 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:00.541469 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-9261e818-bf2b-4c87-bd64-a3bd01b96eea req-47f5517c-d397-4cff-8b32-31ce3ca7c696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03818957-84f5-4de2-8524-06ac54544f52", "name": "network-vif-plugged", "status": "completed", "tag": "8cd2e28a-b15f-4af5-b088-891272292666"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:33:00.550334 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-9261e818-bf2b-4c87-bd64-a3bd01b96eea req-47f5517c-d397-4cff-8b32-31ce3ca7c696 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:00.550886 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-9261e818-bf2b-4c87-bd64-a3bd01b96eea req-47f5517c-d397-4cff-8b32-31ce3ca7c696 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:00.566332 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-9261e818-bf2b-4c87-bd64-a3bd01b96eea req-47f5517c-d397-4cff-8b32-31ce3ca7c696 service nova] Creating event network-vif-plugged:8cd2e28a-b15f-4af5-b088-891272292666 for instance 03818957-84f5-4de2-8524-06ac54544f52 on hv-cinder-85001 Jul 15 15:33:00.572412 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-9261e818-bf2b-4c87-bd64-a3bd01b96eea req-47f5517c-d397-4cff-8b32-31ce3ca7c696 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036034 Jul 15 15:33:00.573179 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 289/583] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:33:00.888458 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-08cf784d-5090-4096-8b7d-3c713f502097 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:00.889078 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-08cf784d-5090-4096-8b7d-3c713f502097 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 03818957-84f5-4de2-8524-06ac54544f52] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:00.895977 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-08cf784d-5090-4096-8b7d-3c713f502097 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:00.896910 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-08cf784d-5090-4096-8b7d-3c713f502097 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:00.897156 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-08cf784d-5090-4096-8b7d-3c713f502097 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:00.897573 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-08cf784d-5090-4096-8b7d-3c713f502097 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:01.055238 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-08cf784d-5090-4096-8b7d-3c713f502097 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:01.064095 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-08cf784d-5090-4096-8b7d-3c713f502097 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52" status: 200 len: 1319 microversion: 2.1 time: 0.179547 Jul 15 15:33:01.064670 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 295/584] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:00 2022] GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:01.401389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-d3751dfb-1d8b-4e19-bec0-24ea64233a32 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:01.402459 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-d3751dfb-1d8b-4e19-bec0-24ea64233a32 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:01.412964 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d3751dfb-1d8b-4e19-bec0-24ea64233a32 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:01.413583 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d3751dfb-1d8b-4e19-bec0-24ea64233a32 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:01.414757 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d3751dfb-1d8b-4e19-bec0-24ea64233a32 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:01.415341 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d3751dfb-1d8b-4e19-bec0-24ea64233a32 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:01.571930 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-d3751dfb-1d8b-4e19-bec0-24ea64233a32 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:01.580299 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-d3751dfb-1d8b-4e19-bec0-24ea64233a32 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1737 microversion: 2.1 time: 0.186246 Jul 15 15:33:01.580966 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 290/585] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:01 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1737 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:02.083001 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9ec0f369-3e0b-45f9-bd0e-f1a1b437da3d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:02.083734 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9ec0f369-3e0b-45f9-bd0e-f1a1b437da3d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 03818957-84f5-4de2-8524-06ac54544f52] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:02.087012 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=58 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:02.093718 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9ec0f369-3e0b-45f9-bd0e-f1a1b437da3d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:02.094160 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9ec0f369-3e0b-45f9-bd0e-f1a1b437da3d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:02.094971 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9ec0f369-3e0b-45f9-bd0e-f1a1b437da3d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:02.095405 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9ec0f369-3e0b-45f9-bd0e-f1a1b437da3d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:02.255250 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9ec0f369-3e0b-45f9-bd0e-f1a1b437da3d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:02.263869 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9ec0f369-3e0b-45f9-bd0e-f1a1b437da3d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52" status: 200 len: 1319 microversion: 2.1 time: 0.185093 Jul 15 15:33:02.264468 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 296/586] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:02 2022] GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:02.599403 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-d1e58194-0747-450e-bb3f-e777a22a9ad9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:02.600062 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-d1e58194-0747-450e-bb3f-e777a22a9ad9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:02.602712 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:02.608470 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d1e58194-0747-450e-bb3f-e777a22a9ad9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:02.608914 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d1e58194-0747-450e-bb3f-e777a22a9ad9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:02.609662 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d1e58194-0747-450e-bb3f-e777a22a9ad9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:02.610086 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d1e58194-0747-450e-bb3f-e777a22a9ad9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:02.615856 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:02.757810 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-d1e58194-0747-450e-bb3f-e777a22a9ad9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:02.766453 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-d1e58194-0747-450e-bb3f-e777a22a9ad9 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1737 microversion: 2.1 time: 0.171236 Jul 15 15:33:02.767056 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 291/587] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:02 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:03.283385 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-69deb079-0a46-4ad4-8613-03edd323db43 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:03.284436 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-69deb079-0a46-4ad4-8613-03edd323db43 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 03818957-84f5-4de2-8524-06ac54544f52] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:03.293441 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-69deb079-0a46-4ad4-8613-03edd323db43 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:03.294095 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-69deb079-0a46-4ad4-8613-03edd323db43 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:03.295492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-69deb079-0a46-4ad4-8613-03edd323db43 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:03.295894 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-69deb079-0a46-4ad4-8613-03edd323db43 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:03.502361 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-69deb079-0a46-4ad4-8613-03edd323db43 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:03.511976 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-69deb079-0a46-4ad4-8613-03edd323db43 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52" status: 200 len: 1319 microversion: 2.1 time: 0.232827 Jul 15 15:33:03.512556 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 297/588] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:03 2022] GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:03.784116 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-8906422e-8cab-445a-aa04-83659b8224b5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:03.784807 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-8906422e-8cab-445a-aa04-83659b8224b5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:03.794174 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8906422e-8cab-445a-aa04-83659b8224b5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:03.794780 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8906422e-8cab-445a-aa04-83659b8224b5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:03.795732 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8906422e-8cab-445a-aa04-83659b8224b5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:03.796285 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8906422e-8cab-445a-aa04-83659b8224b5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:03.961713 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-8906422e-8cab-445a-aa04-83659b8224b5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:03.970815 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-8906422e-8cab-445a-aa04-83659b8224b5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1737 microversion: 2.1 time: 0.190856 Jul 15 15:33:03.972158 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 292/589] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:03 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1737 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:04.539389 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6505438c-f444-42be-902a-96eb399bae29 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:04.540337 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6505438c-f444-42be-902a-96eb399bae29 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 03818957-84f5-4de2-8524-06ac54544f52] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:04.549511 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6505438c-f444-42be-902a-96eb399bae29 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:04.549946 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6505438c-f444-42be-902a-96eb399bae29 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:04.550816 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6505438c-f444-42be-902a-96eb399bae29 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:04.551239 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6505438c-f444-42be-902a-96eb399bae29 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:04.694369 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6505438c-f444-42be-902a-96eb399bae29 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:04.707208 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6505438c-f444-42be-902a-96eb399bae29 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52" status: 200 len: 1508 microversion: 2.1 time: 0.174010 Jul 15 15:33:04.708082 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 298/590] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:04 2022] GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52 => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:04.726897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-f274f0a9-1808-43e9-a4bf-22bc39325f6b tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48c10e6f-8752-4591-9f21-1d8003056ffa", "device": "/dev/sdb"}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:33:04.728045 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-f274f0a9-1808-43e9-a4bf-22bc39325f6b tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 03818957-84f5-4de2-8524-06ac54544f52] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:04.735340 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f274f0a9-1808-43e9-a4bf-22bc39325f6b tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:04.735875 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f274f0a9-1808-43e9-a4bf-22bc39325f6b tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:04.736737 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f274f0a9-1808-43e9-a4bf-22bc39325f6b tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:04.737174 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f274f0a9-1808-43e9-a4bf-22bc39325f6b tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:04.990855 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9deab209-c108-4176-b6ac-150c194a0dfd tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:04.999615 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9deab209-c108-4176-b6ac-150c194a0dfd tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:05.005322 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9deab209-c108-4176-b6ac-150c194a0dfd tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:05.005865 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9deab209-c108-4176-b6ac-150c194a0dfd tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:05.006995 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9deab209-c108-4176-b6ac-150c194a0dfd tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:05.007427 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9deab209-c108-4176-b6ac-150c194a0dfd tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:05.053928 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-f274f0a9-1808-43e9-a4bf-22bc39325f6b tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "POST /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331883 Jul 15 15:33:05.059743 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 293/591] 10.222.0.40 () {60 vars in 1322 bytes} [Fri Jul 15 15:33:04 2022] POST /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:33:05.179793 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9deab209-c108-4176-b6ac-150c194a0dfd tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:05.191960 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9deab209-c108-4176-b6ac-150c194a0dfd tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1737 microversion: 2.1 time: 0.206224 Jul 15 15:33:05.192546 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 299/592] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:04 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1737 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:06.211711 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-f7c5954f-54f9-450f-bca8-2ef9406c6e46 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:06.212399 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-f7c5954f-54f9-450f-bca8-2ef9406c6e46 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:06.219734 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f7c5954f-54f9-450f-bca8-2ef9406c6e46 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:06.220171 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f7c5954f-54f9-450f-bca8-2ef9406c6e46 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:06.220928 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f7c5954f-54f9-450f-bca8-2ef9406c6e46 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:06.221344 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f7c5954f-54f9-450f-bca8-2ef9406c6e46 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:06.365902 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f7c5954f-54f9-450f-bca8-2ef9406c6e46 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:06.375933 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-f7c5954f-54f9-450f-bca8-2ef9406c6e46 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1737 microversion: 2.1 time: 0.169279 Jul 15 15:33:06.376576 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 294/593] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:06 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:07.394552 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-be67cc36-3db2-481a-b055-70237f238dcc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:07.395363 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-be67cc36-3db2-481a-b055-70237f238dcc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:07.402914 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-be67cc36-3db2-481a-b055-70237f238dcc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:07.403473 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-be67cc36-3db2-481a-b055-70237f238dcc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:07.404307 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-be67cc36-3db2-481a-b055-70237f238dcc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:07.404847 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-be67cc36-3db2-481a-b055-70237f238dcc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:07.565020 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-be67cc36-3db2-481a-b055-70237f238dcc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:07.573700 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-be67cc36-3db2-481a-b055-70237f238dcc tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1737 microversion: 2.1 time: 0.183802 Jul 15 15:33:07.574347 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 300/594] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:07 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:08.593267 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-af9bcbc6-590e-443b-890e-9ab86dbdb078 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:08.594209 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-af9bcbc6-590e-443b-890e-9ab86dbdb078 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:08.603018 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-af9bcbc6-590e-443b-890e-9ab86dbdb078 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:08.603736 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-af9bcbc6-590e-443b-890e-9ab86dbdb078 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:08.604959 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-af9bcbc6-590e-443b-890e-9ab86dbdb078 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:08.605684 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-af9bcbc6-590e-443b-890e-9ab86dbdb078 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:08.765866 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-af9bcbc6-590e-443b-890e-9ab86dbdb078 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:08.775549 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-af9bcbc6-590e-443b-890e-9ab86dbdb078 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1737 microversion: 2.1 time: 0.186763 Jul 15 15:33:08.776194 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 295/595] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:08 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1737 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:09.734184 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 15:33:09.735074 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Fri Jul 15 15:33:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 15:33:09.795329 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-35c3cffe-5e3f-4e89-9448-0bdccc1fb856 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:09.795935 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-35c3cffe-5e3f-4e89-9448-0bdccc1fb856 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:09.803292 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-35c3cffe-5e3f-4e89-9448-0bdccc1fb856 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:09.803756 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-35c3cffe-5e3f-4e89-9448-0bdccc1fb856 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:09.804512 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-35c3cffe-5e3f-4e89-9448-0bdccc1fb856 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:09.804937 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-35c3cffe-5e3f-4e89-9448-0bdccc1fb856 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:09.971632 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-35c3cffe-5e3f-4e89-9448-0bdccc1fb856 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:09.981480 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-35c3cffe-5e3f-4e89-9448-0bdccc1fb856 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1737 microversion: 2.1 time: 0.189977 Jul 15 15:33:09.982381 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 301/596] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:09 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1737 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:33:11.000589 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-829069d9-120b-4e06-ae25-5f28602f1365 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:11.001320 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-829069d9-120b-4e06-ae25-5f28602f1365 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:11.008081 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-829069d9-120b-4e06-ae25-5f28602f1365 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:11.008516 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-829069d9-120b-4e06-ae25-5f28602f1365 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:11.009276 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-829069d9-120b-4e06-ae25-5f28602f1365 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:11.009961 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-829069d9-120b-4e06-ae25-5f28602f1365 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:11.166239 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-829069d9-120b-4e06-ae25-5f28602f1365 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:11.176877 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-829069d9-120b-4e06-ae25-5f28602f1365 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1737 microversion: 2.1 time: 0.180186 Jul 15 15:33:11.177453 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 296/597] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:10 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:12.197568 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-62cd1b14-5b3b-4f07-848a-9c9a2a8afc29 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:12.198141 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-62cd1b14-5b3b-4f07-848a-9c9a2a8afc29 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:12.205559 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-62cd1b14-5b3b-4f07-848a-9c9a2a8afc29 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:12.206008 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-62cd1b14-5b3b-4f07-848a-9c9a2a8afc29 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:12.208151 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-62cd1b14-5b3b-4f07-848a-9c9a2a8afc29 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:12.208582 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-62cd1b14-5b3b-4f07-848a-9c9a2a8afc29 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:12.356145 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-62cd1b14-5b3b-4f07-848a-9c9a2a8afc29 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:12.365942 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-62cd1b14-5b3b-4f07-848a-9c9a2a8afc29 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1737 microversion: 2.1 time: 0.172274 Jul 15 15:33:12.366553 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 302/598] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:12 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:13.391870 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-e66b7b80-a455-4ef3-8440-e74847f6b836 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:13.392675 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-e66b7b80-a455-4ef3-8440-e74847f6b836 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:13.400018 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e66b7b80-a455-4ef3-8440-e74847f6b836 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:13.400462 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e66b7b80-a455-4ef3-8440-e74847f6b836 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:13.401233 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e66b7b80-a455-4ef3-8440-e74847f6b836 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:13.401709 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e66b7b80-a455-4ef3-8440-e74847f6b836 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:13.552198 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e66b7b80-a455-4ef3-8440-e74847f6b836 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:13.561014 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-e66b7b80-a455-4ef3-8440-e74847f6b836 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1717 microversion: 2.1 time: 0.175904 Jul 15 15:33:13.561594 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 297/599] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:13 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1717 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:13.635203 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a14b87fa-0c17-4da8-adb6-921c4006ff4a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:13.636684 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a14b87fa-0c17-4da8-adb6-921c4006ff4a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:13.647255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a14b87fa-0c17-4da8-adb6-921c4006ff4a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:13.648302 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a14b87fa-0c17-4da8-adb6-921c4006ff4a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:13.649552 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a14b87fa-0c17-4da8-adb6-921c4006ff4a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:13.650319 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a14b87fa-0c17-4da8-adb6-921c4006ff4a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:13.746666 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-a14b87fa-0c17-4da8-adb6-921c4006ff4a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] HTTP exception thrown: Cannot 'detach_volume' instance 5eead4bb-c878-4229-b3fc-85f35ec8c5f8 while it is in vm_state rescued Jul 15 15:33:13.748361 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a14b87fa-0c17-4da8-adb6-921c4006ff4a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Request method failure captured: Jul 15 15:33:13.748361 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: DELETE /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8/os-volume_attachments/6373bd49-176a-477f-b54c-32e42dac79fd HTTP/1.1 Jul 15 15:33:13.748361 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:33:13.748361 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:33:13.748361 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:33:13.748361 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 15 15:33:13.748361 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:33:13.748361 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:33:13.748361 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:33:13.748361 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:33:13.748361 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0YcsFZkCZjkBbmSTXB7UwekvD5WNzeaEbNt0rITlIw_1hzYJxVEjCSvTE3Iz-khRfNW59h8CDuHoTt68mQeVPMhdAmhxbIqofx4vXjqK5T_vcExmq4CdFYJ8LNVUNZ_zMmgWfaeigTLlD9bCaozXsDQmwZpOGCKkhLeeXY2KxB1RuxI Jul 15 15:33:13.748361 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:33:13.748361 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:33:13.748361 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:33:13.748361 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:33:13.748361 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:33:13.748361 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:33:13.748361 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: 1e21747a454c4ebebb5d48b5906d5e5c Jul 15 15:33:13.748361 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2035142133 Jul 15 15:33:13.748361 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:33:13.748361 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:33:13.750011 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1e21747a454c4ebebb5d48b5906d5e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1e21747a454c4ebebb5d48b5906d5e5c", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1e21747a454c4ebebb5d48b5906d5e5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1e21747a454c4ebebb5d48b5906d5e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:33:13.750011 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2035142133 Jul 15 15:33:13.750011 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 1e21747a454c4ebebb5d48b5906d5e5c Jul 15 15:33:13.750011 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2035142133 Jul 15 15:33:13.750011 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-ServerRescueNegativeTestJSON-2035142133-project Jul 15 15:33:13.750011 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:33:13.750011 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:33:13.750011 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: c1a1af21d3f94b70a830b14200619f87 Jul 15 15:33:13.750011 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2035142133-project Jul 15 15:33:13.750011 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: > Jul 15 15:33:13.750011 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Cannot 'detach_volume' instance 5eead4bb-c878-4229-b3fc-85f35ec8c5f8 while it is in vm_state rescued Jul 15 15:33:13.750982 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'server_id': '5eead4bb-c878-4229-b3fc-85f35ec8c5f8', 'id': '6373bd49-176a-477f-b54c-32e42dac79fd'} Jul 15 15:33:13.750982 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:33:13.750982 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:33:13.750982 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 15 15:33:13.750982 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 15 15:33:13.750982 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 15 15:33:13.750982 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 15 15:33:13.750982 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 15 15:33:13.750982 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 15 15:33:13.750982 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5eead4bb-c878-4229-b3fc-85f35ec8c5f8 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 15 15:33:13.750982 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:33:13.750982 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:33:13.750982 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:33:13.750982 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:33:13.750982 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:33:13.750982 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:33:13.750982 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:33:13.750982 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:33:13.750982 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:33:13.750982 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:33:13.752486 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 15 15:33:13.752486 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 15 15:33:13.752486 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 15 15:33:13.752486 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 15 15:33:13.752486 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5eead4bb-c878-4229-b3fc-85f35ec8c5f8 while it is in vm_state rescued Jul 15 15:33:13.752486 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:33:13.752486 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:33:13.752486 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:33:13.752486 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:33:13.752486 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:33:13.752486 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:33:13.752486 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:33:13.752486 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:33:13.752486 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5eead4bb-c878-4229-b3fc-85f35ec8c5f8 while it is in vm_state rescued Jul 15 15:33:13.752486 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:33:13.752486 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a14b87fa-0c17-4da8-adb6-921c4006ff4a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Returning 409 to user: Cannot 'detach_volume' instance 5eead4bb-c878-4229-b3fc-85f35ec8c5f8 while it is in vm_state rescued {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:33:13.753612 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a14b87fa-0c17-4da8-adb6-921c4006ff4a tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8/os-volume_attachments/6373bd49-176a-477f-b54c-32e42dac79fd" status: 409 len: 152 microversion: 2.1 time: 0.119838 Jul 15 15:33:13.753612 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 303/600] 10.222.0.40 () {58 vars in 1415 bytes} [Fri Jul 15 15:33:13 2022] DELETE /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8/os-volume_attachments/6373bd49-176a-477f-b54c-32e42dac79fd => generated 152 bytes in 121 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 15 15:33:13.759818 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-a6874584-a139-48c5-a0a3-b62eca22d5ca tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:33:13.760860 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-a6874584-a139-48c5-a0a3-b62eca22d5ca tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:13.769031 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a6874584-a139-48c5-a0a3-b62eca22d5ca tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:13.769729 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a6874584-a139-48c5-a0a3-b62eca22d5ca tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:13.770899 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a6874584-a139-48c5-a0a3-b62eca22d5ca tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:13.771687 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a6874584-a139-48c5-a0a3-b62eca22d5ca tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:13.861155 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-a6874584-a139-48c5-a0a3-b62eca22d5ca tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "POST /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8/action" status: 202 len: 0 microversion: 2.1 time: 0.105354 Jul 15 15:33:13.862209 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 298/601] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 15 15:33:13 2022] POST /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:33:13.872313 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c81dad44-f712-4b79-86df-34e56370e459 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:13.872946 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-c81dad44-f712-4b79-86df-34e56370e459 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:13.879400 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c81dad44-f712-4b79-86df-34e56370e459 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:13.880627 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c81dad44-f712-4b79-86df-34e56370e459 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:13.880627 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c81dad44-f712-4b79-86df-34e56370e459 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:13.881224 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c81dad44-f712-4b79-86df-34e56370e459 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:14.061029 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c81dad44-f712-4b79-86df-34e56370e459 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:14.064803 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=100 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:14.070918 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-c81dad44-f712-4b79-86df-34e56370e459 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1725 microversion: 2.1 time: 0.203085 Jul 15 15:33:14.071503 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 304/602] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:13 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:33:15.093964 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-38b490cd-03ba-44ad-b6be-58acbbe35270 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:15.094729 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-38b490cd-03ba-44ad-b6be-58acbbe35270 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:15.102247 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-38b490cd-03ba-44ad-b6be-58acbbe35270 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:15.103153 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-38b490cd-03ba-44ad-b6be-58acbbe35270 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:15.103594 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-38b490cd-03ba-44ad-b6be-58acbbe35270 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:15.104041 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-38b490cd-03ba-44ad-b6be-58acbbe35270 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:15.273814 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-38b490cd-03ba-44ad-b6be-58acbbe35270 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:15.283331 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-38b490cd-03ba-44ad-b6be-58acbbe35270 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1725 microversion: 2.1 time: 0.194447 Jul 15 15:33:15.283950 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 299/603] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:15 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:16.301741 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8ebd0816-1ef2-4ebe-8f9c-649f3a4806f4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:16.302376 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8ebd0816-1ef2-4ebe-8f9c-649f3a4806f4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:16.311516 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8ebd0816-1ef2-4ebe-8f9c-649f3a4806f4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:16.312000 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8ebd0816-1ef2-4ebe-8f9c-649f3a4806f4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:16.312779 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8ebd0816-1ef2-4ebe-8f9c-649f3a4806f4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:16.313208 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8ebd0816-1ef2-4ebe-8f9c-649f3a4806f4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:16.457857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8ebd0816-1ef2-4ebe-8f9c-649f3a4806f4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:16.466988 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8ebd0816-1ef2-4ebe-8f9c-649f3a4806f4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1725 microversion: 2.1 time: 0.169056 Jul 15 15:33:16.467631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 305/604] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:16 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:17.485760 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-910bfffa-d99d-41b7-8db8-e09c45735e9d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:17.486364 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-910bfffa-d99d-41b7-8db8-e09c45735e9d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:17.495182 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-910bfffa-d99d-41b7-8db8-e09c45735e9d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:17.495612 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-910bfffa-d99d-41b7-8db8-e09c45735e9d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:17.496381 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-910bfffa-d99d-41b7-8db8-e09c45735e9d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:17.496802 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-910bfffa-d99d-41b7-8db8-e09c45735e9d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:17.640069 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-910bfffa-d99d-41b7-8db8-e09c45735e9d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:17.648752 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-910bfffa-d99d-41b7-8db8-e09c45735e9d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1725 microversion: 2.1 time: 0.166862 Jul 15 15:33:17.649338 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 300/605] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:17 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:18.666807 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-628c94cd-d599-42c5-9a4e-3691b15a3fe8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:18.667421 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-628c94cd-d599-42c5-9a4e-3691b15a3fe8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:18.674563 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-628c94cd-d599-42c5-9a4e-3691b15a3fe8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:18.675059 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-628c94cd-d599-42c5-9a4e-3691b15a3fe8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:18.675822 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-628c94cd-d599-42c5-9a4e-3691b15a3fe8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:18.676251 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-628c94cd-d599-42c5-9a4e-3691b15a3fe8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:18.824760 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-628c94cd-d599-42c5-9a4e-3691b15a3fe8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:18.833328 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-628c94cd-d599-42c5-9a4e-3691b15a3fe8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1725 microversion: 2.1 time: 0.170556 Jul 15 15:33:18.833906 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 306/606] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:18 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:19.861015 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-2d80fd87-e1fe-436d-9778-91ef520cc143 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:19.861606 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-2d80fd87-e1fe-436d-9778-91ef520cc143 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:19.869424 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2d80fd87-e1fe-436d-9778-91ef520cc143 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:19.869857 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2d80fd87-e1fe-436d-9778-91ef520cc143 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:19.870698 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2d80fd87-e1fe-436d-9778-91ef520cc143 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:19.871126 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2d80fd87-e1fe-436d-9778-91ef520cc143 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:20.014270 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-2d80fd87-e1fe-436d-9778-91ef520cc143 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:20.024409 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-2d80fd87-e1fe-436d-9778-91ef520cc143 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1725 microversion: 2.1 time: 0.167172 Jul 15 15:33:20.024991 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 301/607] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:19 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:20.730555 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-548302af-77bb-40b5-895f-4fb5d35ec074 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:20.731174 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-548302af-77bb-40b5-895f-4fb5d35ec074 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:20.741920 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-548302af-77bb-40b5-895f-4fb5d35ec074 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:20.742948 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-548302af-77bb-40b5-895f-4fb5d35ec074 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:20.744203 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-548302af-77bb-40b5-895f-4fb5d35ec074 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:20.744889 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-548302af-77bb-40b5-895f-4fb5d35ec074 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:20.841071 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.objects.instance [None req-548302af-77bb-40b5-895f-4fb5d35ec074 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lazy-loading 'services' on Instance uuid d95c0294-3423-429b-8bcf-43e2089fca23 {{(pid=117998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:33:20.922907 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-548302af-77bb-40b5-895f-4fb5d35ec074 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23/os-volume_attachments/ddb3dbcb-6427-4ff9-8eda-35fe5e0f4f49" status: 202 len: 0 microversion: 2.1 time: 0.196094 Jul 15 15:33:20.923510 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 307/608] 10.222.0.40 () {58 vars in 1415 bytes} [Fri Jul 15 15:33:20 2022] DELETE /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23/os-volume_attachments/ddb3dbcb-6427-4ff9-8eda-35fe5e0f4f49 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:33:21.043094 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-23c2396d-0ffc-492a-800c-bd5d551a14e8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:21.043662 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-23c2396d-0ffc-492a-800c-bd5d551a14e8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:21.050919 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-23c2396d-0ffc-492a-800c-bd5d551a14e8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:21.051380 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-23c2396d-0ffc-492a-800c-bd5d551a14e8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:21.052165 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-23c2396d-0ffc-492a-800c-bd5d551a14e8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:21.053176 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-23c2396d-0ffc-492a-800c-bd5d551a14e8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:21.193699 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-23c2396d-0ffc-492a-800c-bd5d551a14e8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:21.203983 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-23c2396d-0ffc-492a-800c-bd5d551a14e8 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1725 microversion: 2.1 time: 0.165936 Jul 15 15:33:21.204565 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 302/609] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:21 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:22.223308 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-40dc9181-d802-4b4b-845e-234de789c43b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:22.224016 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-40dc9181-d802-4b4b-845e-234de789c43b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:22.231415 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-40dc9181-d802-4b4b-845e-234de789c43b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:22.231896 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-40dc9181-d802-4b4b-845e-234de789c43b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:22.232724 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-40dc9181-d802-4b4b-845e-234de789c43b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:22.233153 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-40dc9181-d802-4b4b-845e-234de789c43b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:22.422373 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-40dc9181-d802-4b4b-845e-234de789c43b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:22.437218 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-40dc9181-d802-4b4b-845e-234de789c43b tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1725 microversion: 2.1 time: 0.219160 Jul 15 15:33:22.438804 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 308/610] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:22 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:23.457320 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-cead6d79-8304-4138-9f69-06d4cccd6850 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:23.458141 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-cead6d79-8304-4138-9f69-06d4cccd6850 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:23.467368 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cead6d79-8304-4138-9f69-06d4cccd6850 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:23.468075 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cead6d79-8304-4138-9f69-06d4cccd6850 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:23.469365 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cead6d79-8304-4138-9f69-06d4cccd6850 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:23.470080 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cead6d79-8304-4138-9f69-06d4cccd6850 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:23.910648 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-cead6d79-8304-4138-9f69-06d4cccd6850 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:23.919420 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-cead6d79-8304-4138-9f69-06d4cccd6850 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1725 microversion: 2.1 time: 0.466386 Jul 15 15:33:23.920004 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 303/611] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:23 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1725 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:24.939846 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e89ad3c0-5f6e-44f7-861c-c8fcf719ef69 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:24.940424 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e89ad3c0-5f6e-44f7-861c-c8fcf719ef69 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:24.948402 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e89ad3c0-5f6e-44f7-861c-c8fcf719ef69 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:24.948986 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e89ad3c0-5f6e-44f7-861c-c8fcf719ef69 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:24.949915 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e89ad3c0-5f6e-44f7-861c-c8fcf719ef69 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:24.950376 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e89ad3c0-5f6e-44f7-861c-c8fcf719ef69 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:25.097755 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e89ad3c0-5f6e-44f7-861c-c8fcf719ef69 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:25.108994 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e89ad3c0-5f6e-44f7-861c-c8fcf719ef69 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1725 microversion: 2.1 time: 0.171872 Jul 15 15:33:25.108994 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 309/612] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:24 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:26.126051 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-e7bc7adb-915f-44f9-89a4-11edf9f4a565 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:26.126975 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-e7bc7adb-915f-44f9-89a4-11edf9f4a565 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:26.133728 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e7bc7adb-915f-44f9-89a4-11edf9f4a565 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:26.134220 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e7bc7adb-915f-44f9-89a4-11edf9f4a565 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:26.135173 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e7bc7adb-915f-44f9-89a4-11edf9f4a565 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:26.135573 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e7bc7adb-915f-44f9-89a4-11edf9f4a565 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:26.291725 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e7bc7adb-915f-44f9-89a4-11edf9f4a565 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:26.300568 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-e7bc7adb-915f-44f9-89a4-11edf9f4a565 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1725 microversion: 2.1 time: 0.178519 Jul 15 15:33:26.301162 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 304/613] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:26 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:27.318743 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e5be6d09-f828-467a-a102-3c3c3abf0c3c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:27.319342 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e5be6d09-f828-467a-a102-3c3c3abf0c3c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:27.326837 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e5be6d09-f828-467a-a102-3c3c3abf0c3c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:27.327425 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e5be6d09-f828-467a-a102-3c3c3abf0c3c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:27.328070 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e5be6d09-f828-467a-a102-3c3c3abf0c3c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:27.328525 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e5be6d09-f828-467a-a102-3c3c3abf0c3c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:27.488024 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e5be6d09-f828-467a-a102-3c3c3abf0c3c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:27.503418 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e5be6d09-f828-467a-a102-3c3c3abf0c3c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1725 microversion: 2.1 time: 0.188190 Jul 15 15:33:27.504409 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 310/614] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:27 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:28.522401 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-467c53ed-d395-4397-ac0f-6258b5bd8e77 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:28.523114 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-467c53ed-d395-4397-ac0f-6258b5bd8e77 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:28.530705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-467c53ed-d395-4397-ac0f-6258b5bd8e77 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:28.531144 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-467c53ed-d395-4397-ac0f-6258b5bd8e77 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:28.531928 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-467c53ed-d395-4397-ac0f-6258b5bd8e77 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:28.532355 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-467c53ed-d395-4397-ac0f-6258b5bd8e77 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:28.554211 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:28.698510 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-467c53ed-d395-4397-ac0f-6258b5bd8e77 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:28.712328 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-467c53ed-d395-4397-ac0f-6258b5bd8e77 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1725 microversion: 2.1 time: 0.193513 Jul 15 15:33:28.717700 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 305/615] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:28 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:29.735447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-556f21b5-4b4b-40b2-9ac2-e283fc19dee4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:29.736132 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-556f21b5-4b4b-40b2-9ac2-e283fc19dee4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:29.743847 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-556f21b5-4b4b-40b2-9ac2-e283fc19dee4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:29.744297 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-556f21b5-4b4b-40b2-9ac2-e283fc19dee4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:29.745084 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-556f21b5-4b4b-40b2-9ac2-e283fc19dee4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:29.745514 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-556f21b5-4b4b-40b2-9ac2-e283fc19dee4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:29.999837 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-556f21b5-4b4b-40b2-9ac2-e283fc19dee4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:30.008676 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-556f21b5-4b4b-40b2-9ac2-e283fc19dee4 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1731 microversion: 2.1 time: 0.277184 Jul 15 15:33:30.009311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 311/616] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:29 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1731 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:30.025710 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-451140dd-3eb4-42fa-a855-c1cd603624cb tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:30.026327 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-451140dd-3eb4-42fa-a855-c1cd603624cb tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:30.033306 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-451140dd-3eb4-42fa-a855-c1cd603624cb tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:30.033753 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-451140dd-3eb4-42fa-a855-c1cd603624cb tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:30.034551 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-451140dd-3eb4-42fa-a855-c1cd603624cb tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:30.034977 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-451140dd-3eb4-42fa-a855-c1cd603624cb tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:30.159576 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-451140dd-3eb4-42fa-a855-c1cd603624cb tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.137732 Jul 15 15:33:30.160206 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 306/617] 10.222.0.40 () {58 vars in 1274 bytes} [Fri Jul 15 15:33:30 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8/os-interface => generated 285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:33:31.242263 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-dde6f6a6-3836-4950-88ad-0363770b4caf req-4d823b03-c14c-4264-8701-2a8063dc7b2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eead4bb-c878-4229-b3fc-85f35ec8c5f8", "tag": "680a99e9-4626-4827-a330-033935ba1c3c"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:33:31.250691 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-dde6f6a6-3836-4950-88ad-0363770b4caf req-4d823b03-c14c-4264-8701-2a8063dc7b2d service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:31.251128 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-dde6f6a6-3836-4950-88ad-0363770b4caf req-4d823b03-c14c-4264-8701-2a8063dc7b2d service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:31.267056 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-dde6f6a6-3836-4950-88ad-0363770b4caf req-4d823b03-c14c-4264-8701-2a8063dc7b2d service nova] Creating event network-changed:680a99e9-4626-4827-a330-033935ba1c3c for instance 5eead4bb-c878-4229-b3fc-85f35ec8c5f8 on hv-cinder-85001 Jul 15 15:33:31.283836 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-dde6f6a6-3836-4950-88ad-0363770b4caf req-4d823b03-c14c-4264-8701-2a8063dc7b2d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103559 Jul 15 15:33:31.285714 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 312/618] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:33:31.633761 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-a99daa7a-d3ed-4c87-9e3e-1ae64b0e3e4a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:33:31.640319 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a99daa7a-d3ed-4c87-9e3e-1ae64b0e3e4a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:31.640846 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a99daa7a-d3ed-4c87-9e3e-1ae64b0e3e4a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:31.711382 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-a99daa7a-d3ed-4c87-9e3e-1ae64b0e3e4a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Going to try to stop instance {{(pid=117999) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 15 15:33:31.773362 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-a99daa7a-d3ed-4c87-9e3e-1ae64b0e3e4a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "POST /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23/action" status: 202 len: 0 microversion: 2.1 time: 0.144038 Jul 15 15:33:31.774638 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 307/619] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 15 15:33:31 2022] POST /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:33:31.790339 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-851e446d-ed2b-46ea-baea-dd11b9134e65 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:31.792884 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-851e446d-ed2b-46ea-baea-dd11b9134e65 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:31.805438 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-851e446d-ed2b-46ea-baea-dd11b9134e65 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:31.806968 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-851e446d-ed2b-46ea-baea-dd11b9134e65 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:31.807934 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-851e446d-ed2b-46ea-baea-dd11b9134e65 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:31.808520 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-851e446d-ed2b-46ea-baea-dd11b9134e65 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:32.041598 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-851e446d-ed2b-46ea-baea-dd11b9134e65 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:32.050295 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-851e446d-ed2b-46ea-baea-dd11b9134e65 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1677 microversion: 2.1 time: 0.271671 Jul 15 15:33:32.051021 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 313/620] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:31 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1677 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:32.067954 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-9e4dd322-b5e7-4627-aed9-aa88a2f07377 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:32.069292 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-9e4dd322-b5e7-4627-aed9-aa88a2f07377 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 03818957-84f5-4de2-8524-06ac54544f52] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:32.078932 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9e4dd322-b5e7-4627-aed9-aa88a2f07377 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:32.079624 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9e4dd322-b5e7-4627-aed9-aa88a2f07377 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:32.081004 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9e4dd322-b5e7-4627-aed9-aa88a2f07377 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:32.081636 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9e4dd322-b5e7-4627-aed9-aa88a2f07377 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:32.232208 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.objects.instance [None req-9e4dd322-b5e7-4627-aed9-aa88a2f07377 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lazy-loading 'services' on Instance uuid 03818957-84f5-4de2-8524-06ac54544f52 {{(pid=117999) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:33:32.354214 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-9e4dd322-b5e7-4627-aed9-aa88a2f07377 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "DELETE /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52/os-volume_attachments/48c10e6f-8752-4591-9f21-1d8003056ffa" status: 202 len: 0 microversion: 2.1 time: 0.290738 Jul 15 15:33:32.354943 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 308/621] 10.222.0.40 () {58 vars in 1415 bytes} [Fri Jul 15 15:33:32 2022] DELETE /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52/os-volume_attachments/48c10e6f-8752-4591-9f21-1d8003056ffa => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:33:33.069597 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6d45c05e-d598-4596-8c57-01d1e5d18cdb tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:33.070202 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6d45c05e-d598-4596-8c57-01d1e5d18cdb tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:33.072819 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=36 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:33.079297 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6d45c05e-d598-4596-8c57-01d1e5d18cdb tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:33.079822 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6d45c05e-d598-4596-8c57-01d1e5d18cdb tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:33.080864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6d45c05e-d598-4596-8c57-01d1e5d18cdb tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:33.081650 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6d45c05e-d598-4596-8c57-01d1e5d18cdb tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:33.234079 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6d45c05e-d598-4596-8c57-01d1e5d18cdb tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:33.243434 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6d45c05e-d598-4596-8c57-01d1e5d18cdb tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1677 microversion: 2.1 time: 0.179080 Jul 15 15:33:33.244023 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 314/622] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:33 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:33.304416 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-39a487db-09b0-4015-acce-c0e66a1c2046 req-3c71dded-5d1c-4b63-9f0a-413325d2b153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eead4bb-c878-4229-b3fc-85f35ec8c5f8", "tag": "680a99e9-4626-4827-a330-033935ba1c3c"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:33:33.308018 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=36 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:33.316611 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-39a487db-09b0-4015-acce-c0e66a1c2046 req-3c71dded-5d1c-4b63-9f0a-413325d2b153 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:33.317418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-39a487db-09b0-4015-acce-c0e66a1c2046 req-3c71dded-5d1c-4b63-9f0a-413325d2b153 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:33.329412 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-39a487db-09b0-4015-acce-c0e66a1c2046 req-3c71dded-5d1c-4b63-9f0a-413325d2b153 service nova] Creating event network-changed:680a99e9-4626-4827-a330-033935ba1c3c for instance 5eead4bb-c878-4229-b3fc-85f35ec8c5f8 on hv-cinder-85001 Jul 15 15:33:33.334969 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-39a487db-09b0-4015-acce-c0e66a1c2046 req-3c71dded-5d1c-4b63-9f0a-413325d2b153 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035459 Jul 15 15:33:33.335654 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 309/623] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:33:34.262430 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3c16810b-f412-4f33-aefc-ce5c0833b4f8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:34.263100 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3c16810b-f412-4f33-aefc-ce5c0833b4f8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:34.270678 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3c16810b-f412-4f33-aefc-ce5c0833b4f8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:34.271127 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3c16810b-f412-4f33-aefc-ce5c0833b4f8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:34.271957 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3c16810b-f412-4f33-aefc-ce5c0833b4f8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:34.272406 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3c16810b-f412-4f33-aefc-ce5c0833b4f8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:34.421597 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3c16810b-f412-4f33-aefc-ce5c0833b4f8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:34.430727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3c16810b-f412-4f33-aefc-ce5c0833b4f8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1677 microversion: 2.1 time: 0.172426 Jul 15 15:33:34.431669 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 315/624] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:34 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:34.556376 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-318c676d-ec2e-46b9-9bbf-93e82a1443f6 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:34.557167 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-318c676d-ec2e-46b9-9bbf-93e82a1443f6 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 03818957-84f5-4de2-8524-06ac54544f52] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:34.564161 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-318c676d-ec2e-46b9-9bbf-93e82a1443f6 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:34.564620 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-318c676d-ec2e-46b9-9bbf-93e82a1443f6 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:34.565412 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-318c676d-ec2e-46b9-9bbf-93e82a1443f6 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:34.565880 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-318c676d-ec2e-46b9-9bbf-93e82a1443f6 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:34.592767 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-318c676d-ec2e-46b9-9bbf-93e82a1443f6 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 03818957-84f5-4de2-8524-06ac54544f52] Going to try to terminate instance {{(pid=117999) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 15:33:34.703489 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-318c676d-ec2e-46b9-9bbf-93e82a1443f6 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "DELETE /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52" status: 204 len: 0 microversion: 2.1 time: 0.150153 Jul 15 15:33:34.704149 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 310/625] 10.222.0.40 () {58 vars in 1238 bytes} [Fri Jul 15 15:33:34 2022] DELETE /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:33:34.713465 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2398a3a1-3b2b-4ce8-a0ae-d2f6d5d1051d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:34.714169 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-2398a3a1-3b2b-4ce8-a0ae-d2f6d5d1051d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 03818957-84f5-4de2-8524-06ac54544f52] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:34.721920 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2398a3a1-3b2b-4ce8-a0ae-d2f6d5d1051d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:34.722486 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2398a3a1-3b2b-4ce8-a0ae-d2f6d5d1051d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:34.723552 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2398a3a1-3b2b-4ce8-a0ae-d2f6d5d1051d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:34.724107 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2398a3a1-3b2b-4ce8-a0ae-d2f6d5d1051d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:34.888638 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2398a3a1-3b2b-4ce8-a0ae-d2f6d5d1051d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:34.897405 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-2398a3a1-3b2b-4ce8-a0ae-d2f6d5d1051d tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52" status: 200 len: 1514 microversion: 2.1 time: 0.188454 Jul 15 15:33:34.897977 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 316/626] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:34 2022] GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52 => generated 1514 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:35.450444 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-75644e73-2fef-4b8b-8df4-5c07d3cfc035 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:35.451135 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-75644e73-2fef-4b8b-8df4-5c07d3cfc035 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:35.457947 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-75644e73-2fef-4b8b-8df4-5c07d3cfc035 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:35.458426 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-75644e73-2fef-4b8b-8df4-5c07d3cfc035 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:35.459102 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-75644e73-2fef-4b8b-8df4-5c07d3cfc035 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:35.459708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-75644e73-2fef-4b8b-8df4-5c07d3cfc035 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:35.607828 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-75644e73-2fef-4b8b-8df4-5c07d3cfc035 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:35.617686 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-75644e73-2fef-4b8b-8df4-5c07d3cfc035 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1677 microversion: 2.1 time: 0.171667 Jul 15 15:33:35.618287 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 311/627] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:35 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:35.915571 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-645bc8af-1753-49cd-8513-9fcf1f02e16b tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:35.916151 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-645bc8af-1753-49cd-8513-9fcf1f02e16b tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 03818957-84f5-4de2-8524-06ac54544f52] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:35.923848 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-645bc8af-1753-49cd-8513-9fcf1f02e16b tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:35.924286 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-645bc8af-1753-49cd-8513-9fcf1f02e16b tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:35.925044 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-645bc8af-1753-49cd-8513-9fcf1f02e16b tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:35.925465 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-645bc8af-1753-49cd-8513-9fcf1f02e16b tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:36.071256 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-645bc8af-1753-49cd-8513-9fcf1f02e16b tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:36.079010 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-645bc8af-1753-49cd-8513-9fcf1f02e16b tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52" status: 200 len: 1514 microversion: 2.1 time: 0.167363 Jul 15 15:33:36.079586 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 317/628] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:35 2022] GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:36.636979 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-789976f7-a345-4f90-b417-3719f7d79d86 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:36.637691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-789976f7-a345-4f90-b417-3719f7d79d86 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:36.645892 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-789976f7-a345-4f90-b417-3719f7d79d86 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:36.646396 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-789976f7-a345-4f90-b417-3719f7d79d86 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:36.647270 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-789976f7-a345-4f90-b417-3719f7d79d86 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:36.647756 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-789976f7-a345-4f90-b417-3719f7d79d86 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:36.792712 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-789976f7-a345-4f90-b417-3719f7d79d86 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:36.801230 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-789976f7-a345-4f90-b417-3719f7d79d86 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1677 microversion: 2.1 time: 0.168400 Jul 15 15:33:36.801829 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 312/629] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:36 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:37.096770 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-bc52df56-80f4-4ebe-b3d8-14544e8f5dd2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:37.097382 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-bc52df56-80f4-4ebe-b3d8-14544e8f5dd2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 03818957-84f5-4de2-8524-06ac54544f52] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:37.103730 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bc52df56-80f4-4ebe-b3d8-14544e8f5dd2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:37.104170 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bc52df56-80f4-4ebe-b3d8-14544e8f5dd2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:37.104916 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bc52df56-80f4-4ebe-b3d8-14544e8f5dd2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:37.105342 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bc52df56-80f4-4ebe-b3d8-14544e8f5dd2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:37.253587 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-bc52df56-80f4-4ebe-b3d8-14544e8f5dd2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:37.261437 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-bc52df56-80f4-4ebe-b3d8-14544e8f5dd2 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52" status: 200 len: 1514 microversion: 2.1 time: 0.169156 Jul 15 15:33:37.262007 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 318/630] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:37 2022] GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:37.826308 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-d1fd222f-e44c-4678-808d-c6aa08fa485b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:37.827559 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-d1fd222f-e44c-4678-808d-c6aa08fa485b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:37.837592 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d1fd222f-e44c-4678-808d-c6aa08fa485b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:37.838016 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d1fd222f-e44c-4678-808d-c6aa08fa485b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:37.838815 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d1fd222f-e44c-4678-808d-c6aa08fa485b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:37.839248 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d1fd222f-e44c-4678-808d-c6aa08fa485b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:38.060206 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-d1fd222f-e44c-4678-808d-c6aa08fa485b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:38.072036 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-d1fd222f-e44c-4678-808d-c6aa08fa485b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1677 microversion: 2.1 time: 0.252671 Jul 15 15:33:38.072718 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 313/631] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:37 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1677 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:38.231259 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-86667fc2-8d49-4193-80a7-c2e9dbd05f25 req-fa87b7b3-a219-4409-b407-17858cfab8e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03818957-84f5-4de2-8524-06ac54544f52", "name": "network-vif-deleted", "tag": "8cd2e28a-b15f-4af5-b088-891272292666"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:33:38.240835 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-86667fc2-8d49-4193-80a7-c2e9dbd05f25 req-fa87b7b3-a219-4409-b407-17858cfab8e7 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:38.241748 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-86667fc2-8d49-4193-80a7-c2e9dbd05f25 req-fa87b7b3-a219-4409-b407-17858cfab8e7 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:38.256902 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-86667fc2-8d49-4193-80a7-c2e9dbd05f25 req-fa87b7b3-a219-4409-b407-17858cfab8e7 service nova] Creating event network-vif-deleted:8cd2e28a-b15f-4af5-b088-891272292666 for instance 03818957-84f5-4de2-8524-06ac54544f52 on hv-cinder-85001 Jul 15 15:33:38.262877 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-86667fc2-8d49-4193-80a7-c2e9dbd05f25 req-fa87b7b3-a219-4409-b407-17858cfab8e7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036308 Jul 15 15:33:38.263606 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 319/632] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:33:38.283034 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-a9e7eaee-b2be-494b-a18c-0eeb83a49b80 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:38.284141 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-a9e7eaee-b2be-494b-a18c-0eeb83a49b80 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 03818957-84f5-4de2-8524-06ac54544f52] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:38.290870 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a9e7eaee-b2be-494b-a18c-0eeb83a49b80 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:38.291399 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a9e7eaee-b2be-494b-a18c-0eeb83a49b80 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:38.292282 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a9e7eaee-b2be-494b-a18c-0eeb83a49b80 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:38.292719 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a9e7eaee-b2be-494b-a18c-0eeb83a49b80 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:38.366030 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-a9e7eaee-b2be-494b-a18c-0eeb83a49b80 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28669cdf427a4012a766df06d598e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd8c6fef93d4313bb7894175242fd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:38.375601 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-a9e7eaee-b2be-494b-a18c-0eeb83a49b80 tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52" status: 200 len: 1304 microversion: 2.1 time: 0.099204 Jul 15 15:33:38.376391 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 314/633] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:38 2022] GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:33:39.092653 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-adedcb66-0c25-4962-91c4-adb71b196183 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:39.093367 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-adedcb66-0c25-4962-91c4-adb71b196183 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:39.100829 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-adedcb66-0c25-4962-91c4-adb71b196183 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:39.101375 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-adedcb66-0c25-4962-91c4-adb71b196183 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:39.102438 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-adedcb66-0c25-4962-91c4-adb71b196183 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:39.103039 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-adedcb66-0c25-4962-91c4-adb71b196183 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:39.260512 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-adedcb66-0c25-4962-91c4-adb71b196183 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:39.269009 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-adedcb66-0c25-4962-91c4-adb71b196183 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1677 microversion: 2.1 time: 0.181128 Jul 15 15:33:39.269573 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 320/634] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:39 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:39.396655 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-79212605-4042-4361-99b9-86ea0855f6ea tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:39.397460 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-79212605-4042-4361-99b9-86ea0855f6ea tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] [instance: 03818957-84f5-4de2-8524-06ac54544f52] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:39.406370 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-79212605-4042-4361-99b9-86ea0855f6ea tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:39.406961 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-79212605-4042-4361-99b9-86ea0855f6ea tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:39.408105 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-79212605-4042-4361-99b9-86ea0855f6ea tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:39.408754 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-79212605-4042-4361-99b9-86ea0855f6ea tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:39.428707 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.wsgi [None req-79212605-4042-4361-99b9-86ea0855f6ea tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] HTTP exception thrown: Instance 03818957-84f5-4de2-8524-06ac54544f52 could not be found. Jul 15 15:33:39.430708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-79212605-4042-4361-99b9-86ea0855f6ea tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Request method failure captured: Jul 15 15:33:39.430708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: request: GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52 HTTP/1.1 Jul 15 15:33:39.430708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept: application/json Jul 15 15:33:39.430708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept-Encoding: identity Jul 15 15:33:39.430708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Connection: close Jul 15 15:33:39.430708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Length: 0 Jul 15 15:33:39.430708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Type: application/json Jul 15 15:33:39.430708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Host: 10.222.0.40 Jul 15 15:33:39.430708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Openstack-System-Scope: None Jul 15 15:33:39.430708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: User-Agent: python-urllib3/1.26.9 Jul 15 15:33:39.430708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Auth-Token: gAAAAABi0YgxXva7d4EJbVMknInIVXFFvEEyx5W4gafXLIUQQBzoxevSEVrwXon6z9CFmWSIgWM2ggDB48DS2zqhh4613e0tRwyaklMWY86mRnlRcbpd2XTbYm3k6Sk8JIFjIsE5qJpqwRDaOvmfYuZOFoSjLU-PdED6AxXE-L-xrzCMz-WBpzE Jul 15 15:33:39.430708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Id: None Jul 15 15:33:39.430708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Name: None Jul 15 15:33:39.430708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Identity-Status: Confirmed Jul 15 15:33:39.430708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Is-Admin-Project: True Jul 15 15:33:39.430708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Id: default Jul 15 15:33:39.430708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Name: Default Jul 15 15:33:39.430708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Id: 6fd8c6fef93d4313bb7894175242fd8c Jul 15 15:33:39.430708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1648674728 Jul 15 15:33:39.430708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Role: member,reader Jul 15 15:33:39.430708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Roles: member,reader Jul 15 15:33:39.432343 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6fd8c6fef93d4313bb7894175242fd8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6fd8c6fef93d4313bb7894175242fd8c", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6fd8c6fef93d4313bb7894175242fd8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6fd8c6fef93d4313bb7894175242fd8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:33:39.432343 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant: tempest-VolumesSnapshotTestJSON-1648674728 Jul 15 15:33:39.432343 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Id: 6fd8c6fef93d4313bb7894175242fd8c Jul 15 15:33:39.432343 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1648674728 Jul 15 15:33:39.432343 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User: tempest-VolumesSnapshotTestJSON-1648674728-project Jul 15 15:33:39.432343 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Id: default Jul 15 15:33:39.432343 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Name: Default Jul 15 15:33:39.432343 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Id: 28669cdf427a4012a766df06d598e54d Jul 15 15:33:39.432343 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Name: tempest-VolumesSnapshotTestJSON-1648674728-project Jul 15 15:33:39.432343 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: method: > Jul 15 15:33:39.432343 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: exception: Instance 03818957-84f5-4de2-8524-06ac54544f52 could not be found. Jul 15 15:33:39.432343 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: action_args: {'id': '03818957-84f5-4de2-8524-06ac54544f52'} Jul 15 15:33:39.433467 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:33:39.433467 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:33:39.433467 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:33:39.433467 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:33:39.433467 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:33:39.433467 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:33:39.433467 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:33:39.433467 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:33:39.433467 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:33:39.433467 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:33:39.433467 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03818957-84f5-4de2-8524-06ac54544f52 could not be found. Jul 15 15:33:39.433467 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:33:39.433467 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:33:39.433467 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:33:39.433467 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:33:39.433467 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:33:39.433467 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:33:39.433467 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:33:39.433467 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:33:39.433467 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:33:39.435061 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:33:39.435061 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:33:39.435061 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:33:39.435061 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:33:39.435061 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:33:39.435061 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:33:39.435061 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:33:39.435061 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03818957-84f5-4de2-8524-06ac54544f52 could not be found. Jul 15 15:33:39.435061 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:33:39.435061 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:33:39.435061 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:33:39.435061 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:33:39.435061 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:33:39.435061 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:33:39.435061 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:33:39.435061 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:33:39.435061 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03818957-84f5-4de2-8524-06ac54544f52 could not be found. Jul 15 15:33:39.435061 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:33:39.436620 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-79212605-4042-4361-99b9-86ea0855f6ea tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] Returning 404 to user: Instance 03818957-84f5-4de2-8524-06ac54544f52 could not be found. {{(pid=117999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:33:39.436620 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-79212605-4042-4361-99b9-86ea0855f6ea tempest-VolumesSnapshotTestJSON-1648674728 tempest-VolumesSnapshotTestJSON-1648674728-project] 10.222.0.40 "GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52" status: 404 len: 111 microversion: 2.1 time: 0.042066 Jul 15 15:33:39.436620 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 315/635] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:39 2022] GET /compute/v2.1/servers/03818957-84f5-4de2-8524-06ac54544f52 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:33:40.290261 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-52502d97-607d-44ec-8345-15a0d08377b3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:40.291276 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-52502d97-607d-44ec-8345-15a0d08377b3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:40.298817 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-52502d97-607d-44ec-8345-15a0d08377b3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:40.299208 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-52502d97-607d-44ec-8345-15a0d08377b3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:40.299953 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-52502d97-607d-44ec-8345-15a0d08377b3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:40.300395 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-52502d97-607d-44ec-8345-15a0d08377b3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:40.464427 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-52502d97-607d-44ec-8345-15a0d08377b3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:40.473722 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-52502d97-607d-44ec-8345-15a0d08377b3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1677 microversion: 2.1 time: 0.189144 Jul 15 15:33:40.474314 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 321/636] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:40 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1677 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:41.491750 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-da635e58-580e-4566-9e27-8d14b28d8a55 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:41.492417 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-da635e58-580e-4566-9e27-8d14b28d8a55 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:41.499690 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-da635e58-580e-4566-9e27-8d14b28d8a55 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:41.500156 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-da635e58-580e-4566-9e27-8d14b28d8a55 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:41.500902 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-da635e58-580e-4566-9e27-8d14b28d8a55 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:41.501321 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-da635e58-580e-4566-9e27-8d14b28d8a55 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:41.647592 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-da635e58-580e-4566-9e27-8d14b28d8a55 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:41.655436 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-da635e58-580e-4566-9e27-8d14b28d8a55 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1677 microversion: 2.1 time: 0.167980 Jul 15 15:33:41.656006 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 316/637] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:41 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:42.674296 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e2a8c18c-53c0-42b9-8ece-b1f6140a3eb3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:42.674903 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e2a8c18c-53c0-42b9-8ece-b1f6140a3eb3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:42.681816 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e2a8c18c-53c0-42b9-8ece-b1f6140a3eb3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:42.682265 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e2a8c18c-53c0-42b9-8ece-b1f6140a3eb3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:42.683063 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e2a8c18c-53c0-42b9-8ece-b1f6140a3eb3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:42.683499 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e2a8c18c-53c0-42b9-8ece-b1f6140a3eb3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:42.687666 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:42.831020 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e2a8c18c-53c0-42b9-8ece-b1f6140a3eb3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:42.839025 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e2a8c18c-53c0-42b9-8ece-b1f6140a3eb3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1677 microversion: 2.1 time: 0.169341 Jul 15 15:33:42.839604 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 322/638] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:42 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:43.857354 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-e3f3f52d-df21-4072-a100-728dd22ee226 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:43.858086 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-e3f3f52d-df21-4072-a100-728dd22ee226 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:43.866071 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e3f3f52d-df21-4072-a100-728dd22ee226 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:43.866511 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e3f3f52d-df21-4072-a100-728dd22ee226 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:43.867349 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e3f3f52d-df21-4072-a100-728dd22ee226 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:43.867809 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e3f3f52d-df21-4072-a100-728dd22ee226 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:44.037461 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e3f3f52d-df21-4072-a100-728dd22ee226 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:44.045345 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-e3f3f52d-df21-4072-a100-728dd22ee226 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1677 microversion: 2.1 time: 0.192027 Jul 15 15:33:44.046089 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 317/639] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:43 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1677 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:45.069498 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7deeacf9-8270-4ec0-b54d-450e1c524e3e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:45.070312 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7deeacf9-8270-4ec0-b54d-450e1c524e3e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:45.079144 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7deeacf9-8270-4ec0-b54d-450e1c524e3e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:45.079558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7deeacf9-8270-4ec0-b54d-450e1c524e3e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:45.080401 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7deeacf9-8270-4ec0-b54d-450e1c524e3e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:45.080860 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7deeacf9-8270-4ec0-b54d-450e1c524e3e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:45.246579 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7deeacf9-8270-4ec0-b54d-450e1c524e3e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:45.255006 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7deeacf9-8270-4ec0-b54d-450e1c524e3e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1677 microversion: 2.1 time: 0.191453 Jul 15 15:33:45.255488 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 323/640] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:45 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1677 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:46.276812 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-0b2038ec-1f19-4689-ac34-0bdfa81e3914 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:46.277922 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-0b2038ec-1f19-4689-ac34-0bdfa81e3914 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:46.291481 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0b2038ec-1f19-4689-ac34-0bdfa81e3914 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:46.292012 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0b2038ec-1f19-4689-ac34-0bdfa81e3914 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:46.292833 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0b2038ec-1f19-4689-ac34-0bdfa81e3914 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:46.293265 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0b2038ec-1f19-4689-ac34-0bdfa81e3914 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:46.468120 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-0b2038ec-1f19-4689-ac34-0bdfa81e3914 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:46.478032 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-0b2038ec-1f19-4689-ac34-0bdfa81e3914 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1677 microversion: 2.1 time: 0.208679 Jul 15 15:33:46.478935 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 318/641] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:46 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1677 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:47.499648 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b3a457d3-99db-4bd9-96e0-9876523493d2 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:47.500587 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b3a457d3-99db-4bd9-96e0-9876523493d2 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:47.508596 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b3a457d3-99db-4bd9-96e0-9876523493d2 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:47.509037 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b3a457d3-99db-4bd9-96e0-9876523493d2 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:47.509805 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b3a457d3-99db-4bd9-96e0-9876523493d2 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:47.510226 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b3a457d3-99db-4bd9-96e0-9876523493d2 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:47.665491 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b3a457d3-99db-4bd9-96e0-9876523493d2 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:47.678047 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b3a457d3-99db-4bd9-96e0-9876523493d2 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1677 microversion: 2.1 time: 0.183509 Jul 15 15:33:47.679284 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 324/642] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:47 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1677 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:48.698242 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-f21ede53-7214-4b25-820d-16f253aebf6d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:48.699117 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-f21ede53-7214-4b25-820d-16f253aebf6d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:48.706315 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f21ede53-7214-4b25-820d-16f253aebf6d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:48.706831 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f21ede53-7214-4b25-820d-16f253aebf6d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:48.707621 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f21ede53-7214-4b25-820d-16f253aebf6d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:48.708053 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f21ede53-7214-4b25-820d-16f253aebf6d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:48.868468 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f21ede53-7214-4b25-820d-16f253aebf6d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:48.884901 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-f21ede53-7214-4b25-820d-16f253aebf6d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1654 microversion: 2.1 time: 0.190781 Jul 15 15:33:48.886108 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 319/643] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:48 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1654 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:48.909836 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3241f879-001a-4577-979c-f1962da6dee1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:33:48.922299 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3241f879-001a-4577-979c-f1962da6dee1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:48.922299 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3241f879-001a-4577-979c-f1962da6dee1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:48.954217 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3241f879-001a-4577-979c-f1962da6dee1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Going to try to start instance {{(pid=117998) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 15 15:33:49.001819 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3241f879-001a-4577-979c-f1962da6dee1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "POST /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23/action" status: 202 len: 0 microversion: 2.1 time: 0.097307 Jul 15 15:33:49.002469 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 325/644] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 15 15:33:48 2022] POST /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 15:33:49.010974 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-9e81517e-a5b4-45f2-92ce-f063d8fa30f5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:49.011592 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-9e81517e-a5b4-45f2-92ce-f063d8fa30f5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:49.017986 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9e81517e-a5b4-45f2-92ce-f063d8fa30f5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:49.018704 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9e81517e-a5b4-45f2-92ce-f063d8fa30f5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:49.019731 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9e81517e-a5b4-45f2-92ce-f063d8fa30f5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:49.020342 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9e81517e-a5b4-45f2-92ce-f063d8fa30f5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:49.040149 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:49.262781 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-9e81517e-a5b4-45f2-92ce-f063d8fa30f5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:49.280970 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-9e81517e-a5b4-45f2-92ce-f063d8fa30f5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1663 microversion: 2.1 time: 0.273296 Jul 15 15:33:49.282314 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 320/645] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:49 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1663 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:50.306350 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-37f0e677-35ac-43da-b7ad-2cb4995008a3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:50.307504 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-37f0e677-35ac-43da-b7ad-2cb4995008a3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:50.314834 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-37f0e677-35ac-43da-b7ad-2cb4995008a3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:50.315269 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-37f0e677-35ac-43da-b7ad-2cb4995008a3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:50.316084 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-37f0e677-35ac-43da-b7ad-2cb4995008a3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:50.316505 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-37f0e677-35ac-43da-b7ad-2cb4995008a3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:50.515675 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-37f0e677-35ac-43da-b7ad-2cb4995008a3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:50.524096 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-37f0e677-35ac-43da-b7ad-2cb4995008a3 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1663 microversion: 2.1 time: 0.224043 Jul 15 15:33:50.524677 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 326/646] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:50 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1663 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:33:51.542402 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-5efbfe0c-58ae-4e17-bfd1-c986cd72ce96 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:33:51.543210 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-5efbfe0c-58ae-4e17-bfd1-c986cd72ce96 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:33:51.551724 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5efbfe0c-58ae-4e17-bfd1-c986cd72ce96 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:51.552279 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5efbfe0c-58ae-4e17-bfd1-c986cd72ce96 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:51.553054 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5efbfe0c-58ae-4e17-bfd1-c986cd72ce96 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:33:51.553514 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5efbfe0c-58ae-4e17-bfd1-c986cd72ce96 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:33:51.712303 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-5efbfe0c-58ae-4e17-bfd1-c986cd72ce96 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:33:51.721145 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-5efbfe0c-58ae-4e17-bfd1-c986cd72ce96 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1667 microversion: 2.1 time: 0.183004 Jul 15 15:33:51.721780 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 321/647] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:33:51 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1667 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:34:41.074335 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-682e217e-1b70-4f16-94f1-aba2c646e8ea tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:34:41.075198 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-682e217e-1b70-4f16-94f1-aba2c646e8ea tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:34:41.077152 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=25 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:41.078023 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:41.084656 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-682e217e-1b70-4f16-94f1-aba2c646e8ea tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:41.085089 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-682e217e-1b70-4f16-94f1-aba2c646e8ea tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:41.085878 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-682e217e-1b70-4f16-94f1-aba2c646e8ea tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:41.086299 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-682e217e-1b70-4f16-94f1-aba2c646e8ea tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:41.121362 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-682e217e-1b70-4f16-94f1-aba2c646e8ea tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849/os-volume_attachments/1094eada-0935-47d4-9d6b-628af0af68af" status: 200 len: 194 microversion: 2.20 time: 0.050659 Jul 15 15:34:41.121362 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 327/648] 10.222.0.40 () {60 vars in 1453 bytes} [Fri Jul 15 15:34:41 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849/os-volume_attachments/1094eada-0935-47d4-9d6b-628af0af68af => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 15 15:34:41.199348 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-6f1cdd91-3356-4fbe-84a7-176c4322cd75 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:34:41.199973 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-6f1cdd91-3356-4fbe-84a7-176c4322cd75 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:34:41.202020 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:41.202760 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=8 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:41.209880 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6f1cdd91-3356-4fbe-84a7-176c4322cd75 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:41.210724 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6f1cdd91-3356-4fbe-84a7-176c4322cd75 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:41.211831 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6f1cdd91-3356-4fbe-84a7-176c4322cd75 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:41.212560 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6f1cdd91-3356-4fbe-84a7-176c4322cd75 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:41.330477 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.objects.instance [None req-6f1cdd91-3356-4fbe-84a7-176c4322cd75 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lazy-loading 'services' on Instance uuid 5180ff6f-38fa-49c2-9663-9269dcae4849 {{(pid=117999) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:34:41.432064 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-6f1cdd91-3356-4fbe-84a7-176c4322cd75 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849/os-volume_attachments/1094eada-0935-47d4-9d6b-628af0af68af" status: 202 len: 0 microversion: 2.20 time: 0.237320 Jul 15 15:34:41.432707 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 322/649] 10.222.0.40 () {60 vars in 1456 bytes} [Fri Jul 15 15:34:41 2022] DELETE /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849/os-volume_attachments/1094eada-0935-47d4-9d6b-628af0af68af => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:34:41.442851 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-88475120-f755-4da1-bf6c-05d26109dc28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:34:41.443836 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-88475120-f755-4da1-bf6c-05d26109dc28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:34:41.451000 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-88475120-f755-4da1-bf6c-05d26109dc28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:41.451444 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-88475120-f755-4da1-bf6c-05d26109dc28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:41.452757 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-88475120-f755-4da1-bf6c-05d26109dc28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:41.453592 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-88475120-f755-4da1-bf6c-05d26109dc28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:41.506058 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-88475120-f755-4da1-bf6c-05d26109dc28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067742 Jul 15 15:34:41.507811 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 15:34:41.507975 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Fri Jul 15 15:34:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 15:34:41.516239 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 328/650] 10.222.0.40 () {60 vars in 1342 bytes} [Fri Jul 15 15:34:41 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:34:42.528009 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-0d9796b4-f2ab-42de-8524-1303e5c07a4e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:34:42.528997 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-0d9796b4-f2ab-42de-8524-1303e5c07a4e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:34:42.536931 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0d9796b4-f2ab-42de-8524-1303e5c07a4e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:42.537368 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0d9796b4-f2ab-42de-8524-1303e5c07a4e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:42.538146 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0d9796b4-f2ab-42de-8524-1303e5c07a4e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:42.538622 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0d9796b4-f2ab-42de-8524-1303e5c07a4e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:42.574990 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-0d9796b4-f2ab-42de-8524-1303e5c07a4e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053276 Jul 15 15:34:42.575913 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 323/651] 10.222.0.40 () {60 vars in 1342 bytes} [Fri Jul 15 15:34:42 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:34:42.660082 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-26b56dc0-a44b-4ef2-b099-05e967218061 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:34:42.660834 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-26b56dc0-a44b-4ef2-b099-05e967218061 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:34:42.669744 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-26b56dc0-a44b-4ef2-b099-05e967218061 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:42.670246 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-26b56dc0-a44b-4ef2-b099-05e967218061 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:42.671114 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-26b56dc0-a44b-4ef2-b099-05e967218061 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:42.671533 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-26b56dc0-a44b-4ef2-b099-05e967218061 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:42.698257 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-26b56dc0-a44b-4ef2-b099-05e967218061 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Going to try to terminate instance {{(pid=117998) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 15:34:42.788732 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-26b56dc0-a44b-4ef2-b099-05e967218061 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 204 len: 0 microversion: 2.20 time: 0.134619 Jul 15 15:34:42.789882 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 329/652] 10.222.0.40 () {60 vars in 1279 bytes} [Fri Jul 15 15:34:42 2022] DELETE /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 15 15:34:42.803422 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-56e861e2-4e45-4e2b-aca6-8223575e5cdc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:34:42.804165 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-56e861e2-4e45-4e2b-aca6-8223575e5cdc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:34:42.812320 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-56e861e2-4e45-4e2b-aca6-8223575e5cdc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:42.812814 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-56e861e2-4e45-4e2b-aca6-8223575e5cdc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:42.813844 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-56e861e2-4e45-4e2b-aca6-8223575e5cdc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:42.814798 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-56e861e2-4e45-4e2b-aca6-8223575e5cdc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:42.991159 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-56e861e2-4e45-4e2b-aca6-8223575e5cdc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:43.001028 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-56e861e2-4e45-4e2b-aca6-8223575e5cdc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:43.002572 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-56e861e2-4e45-4e2b-aca6-8223575e5cdc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:43.003748 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-56e861e2-4e45-4e2b-aca6-8223575e5cdc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1723 microversion: 2.20 time: 0.205240 Jul 15 15:34:43.004339 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 324/653] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:34:42 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:34:44.024944 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7a472c24-5499-498d-bb62-2ae0a88d0301 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:34:44.025803 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7a472c24-5499-498d-bb62-2ae0a88d0301 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:34:44.036697 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7a472c24-5499-498d-bb62-2ae0a88d0301 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:44.036697 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7a472c24-5499-498d-bb62-2ae0a88d0301 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:44.036697 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7a472c24-5499-498d-bb62-2ae0a88d0301 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:44.036697 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7a472c24-5499-498d-bb62-2ae0a88d0301 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:44.207553 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7a472c24-5499-498d-bb62-2ae0a88d0301 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:44.216701 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7a472c24-5499-498d-bb62-2ae0a88d0301 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:44.218443 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7a472c24-5499-498d-bb62-2ae0a88d0301 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:44.219700 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7a472c24-5499-498d-bb62-2ae0a88d0301 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1723 microversion: 2.20 time: 0.200366 Jul 15 15:34:44.220270 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 330/654] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:34:44 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:34:45.239381 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-862aa87d-1b59-4248-a5c2-a6f2cfa99730 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:34:45.240233 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-862aa87d-1b59-4248-a5c2-a6f2cfa99730 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:34:45.249947 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-862aa87d-1b59-4248-a5c2-a6f2cfa99730 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:45.250389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-862aa87d-1b59-4248-a5c2-a6f2cfa99730 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:45.251343 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-862aa87d-1b59-4248-a5c2-a6f2cfa99730 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:45.251783 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-862aa87d-1b59-4248-a5c2-a6f2cfa99730 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:45.560557 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-862aa87d-1b59-4248-a5c2-a6f2cfa99730 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:45.570706 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-862aa87d-1b59-4248-a5c2-a6f2cfa99730 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:45.575637 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-862aa87d-1b59-4248-a5c2-a6f2cfa99730 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:45.581261 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-862aa87d-1b59-4248-a5c2-a6f2cfa99730 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1723 microversion: 2.20 time: 0.346153 Jul 15 15:34:45.581856 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 325/655] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:34:45 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1723 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:34:46.218305 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-a0cebbb6-6c18-438d-8e0b-9fd35da8e1a8 req-28f20019-c473-471a-b05e-e3f9eb3852c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5180ff6f-38fa-49c2-9663-9269dcae4849", "name": "network-vif-deleted", "tag": "03d3bd84-1aa5-4842-b751-250a289b02fe"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:34:46.228560 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-a0cebbb6-6c18-438d-8e0b-9fd35da8e1a8 req-28f20019-c473-471a-b05e-e3f9eb3852c5 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:46.229423 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-a0cebbb6-6c18-438d-8e0b-9fd35da8e1a8 req-28f20019-c473-471a-b05e-e3f9eb3852c5 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:46.267190 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-a0cebbb6-6c18-438d-8e0b-9fd35da8e1a8 req-28f20019-c473-471a-b05e-e3f9eb3852c5 service nova] Creating event network-vif-deleted:03d3bd84-1aa5-4842-b751-250a289b02fe for instance 5180ff6f-38fa-49c2-9663-9269dcae4849 on hv-cinder-85001 Jul 15 15:34:46.277966 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-a0cebbb6-6c18-438d-8e0b-9fd35da8e1a8 req-28f20019-c473-471a-b05e-e3f9eb3852c5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068242 Jul 15 15:34:46.281100 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 331/656] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:34:46.600781 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-849fdb1f-0df5-44ed-8800-6974a080605e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:34:46.601650 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-849fdb1f-0df5-44ed-8800-6974a080605e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:34:46.612753 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-849fdb1f-0df5-44ed-8800-6974a080605e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:46.613253 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-849fdb1f-0df5-44ed-8800-6974a080605e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:46.614339 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-849fdb1f-0df5-44ed-8800-6974a080605e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:46.615165 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-849fdb1f-0df5-44ed-8800-6974a080605e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:46.657662 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-849fdb1f-0df5-44ed-8800-6974a080605e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:46.658228 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-849fdb1f-0df5-44ed-8800-6974a080605e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:46.658778 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.objects.instance [None req-849fdb1f-0df5-44ed-8800-6974a080605e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lazy-loading 'fault' on Instance uuid 5180ff6f-38fa-49c2-9663-9269dcae4849 {{(pid=117999) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:34:46.715050 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-849fdb1f-0df5-44ed-8800-6974a080605e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:46.739423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-849fdb1f-0df5-44ed-8800-6974a080605e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:46.746873 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-849fdb1f-0df5-44ed-8800-6974a080605e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:46.750167 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-849fdb1f-0df5-44ed-8800-6974a080605e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 200 len: 1370 microversion: 2.20 time: 0.153198 Jul 15 15:34:46.753304 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 326/657] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:34:46 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:34:47.775819 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e20260a7-8317-4d79-a82d-cc77fa7f250d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:34:47.776781 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e20260a7-8317-4d79-a82d-cc77fa7f250d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:34:47.791067 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e20260a7-8317-4d79-a82d-cc77fa7f250d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:47.791743 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e20260a7-8317-4d79-a82d-cc77fa7f250d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:47.793035 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e20260a7-8317-4d79-a82d-cc77fa7f250d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:47.793717 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e20260a7-8317-4d79-a82d-cc77fa7f250d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:47.813514 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-e20260a7-8317-4d79-a82d-cc77fa7f250d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] HTTP exception thrown: Instance 5180ff6f-38fa-49c2-9663-9269dcae4849 could not be found. Jul 15 15:34:47.815679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e20260a7-8317-4d79-a82d-cc77fa7f250d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Request method failure captured: Jul 15 15:34:47.815679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 HTTP/1.1 Jul 15 15:34:47.815679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:34:47.815679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:34:47.815679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:34:47.815679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 15 15:34:47.815679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:34:47.815679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:34:47.815679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:34:47.815679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:34:47.815679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0Ycdl5fjv0GHXFYBY8Oj0p_9neOe7aiKLzORnSELZ9fjLn5e5jx-OviD5zymv1hQZjQuA9wjjXExczrciWHH70PFyn90e-Zx5GZfnJGwRvsgtphfFMDIPu7StCyyWG4lRPjFEc89gd3qabEUSD3Ln52Ln4H4tGcPXeHNw7hKu44XOMo Jul 15 15:34:47.815679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:34:47.815679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:34:47.815679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:34:47.815679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:34:47.815679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 15:34:47.815679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:34:47.815679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:34:47.815679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: 83cbbde066834f25a1b6f1bdc28e8b79 Jul 15 15:34:47.815679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-871086534 Jul 15 15:34:47.815679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:34:47.815679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:34:47.818259 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/83cbbde066834f25a1b6f1bdc28e8b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_83cbbde066834f25a1b6f1bdc28e8b79", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/83cbbde066834f25a1b6f1bdc28e8b79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/83cbbde066834f25a1b6f1bdc28e8b79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:34:47.818259 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-AttachVolumeShelveTestJSON-871086534 Jul 15 15:34:47.818259 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 83cbbde066834f25a1b6f1bdc28e8b79 Jul 15 15:34:47.818259 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-871086534 Jul 15 15:34:47.818259 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-AttachVolumeShelveTestJSON-871086534-project Jul 15 15:34:47.818259 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:34:47.818259 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:34:47.818259 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: 9a0d49b3b50b4e668e157cb2e8e47da2 Jul 15 15:34:47.818259 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-AttachVolumeShelveTestJSON-871086534-project Jul 15 15:34:47.818259 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: > Jul 15 15:34:47.818259 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Instance 5180ff6f-38fa-49c2-9663-9269dcae4849 could not be found. Jul 15 15:34:47.818259 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'id': '5180ff6f-38fa-49c2-9663-9269dcae4849'} Jul 15 15:34:47.820727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:34:47.820727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:34:47.820727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:34:47.820727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:34:47.820727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:34:47.820727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:34:47.820727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:34:47.820727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:34:47.820727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:34:47.820727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:34:47.820727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5180ff6f-38fa-49c2-9663-9269dcae4849 could not be found. Jul 15 15:34:47.820727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:34:47.820727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:34:47.820727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:34:47.820727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:34:47.820727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:34:47.820727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:34:47.820727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:34:47.820727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:34:47.820727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:34:47.824179 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:34:47.824179 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:34:47.824179 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:34:47.824179 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:34:47.824179 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:34:47.824179 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:34:47.824179 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:34:47.824179 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5180ff6f-38fa-49c2-9663-9269dcae4849 could not be found. Jul 15 15:34:47.824179 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:34:47.824179 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:34:47.824179 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:34:47.824179 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:34:47.824179 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:34:47.824179 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:34:47.824179 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:34:47.824179 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:34:47.824179 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5180ff6f-38fa-49c2-9663-9269dcae4849 could not be found. Jul 15 15:34:47.824179 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:34:47.826933 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e20260a7-8317-4d79-a82d-cc77fa7f250d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Returning 404 to user: Instance 5180ff6f-38fa-49c2-9663-9269dcae4849 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:34:47.826933 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e20260a7-8317-4d79-a82d-cc77fa7f250d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 404 len: 111 microversion: 2.20 time: 0.047903 Jul 15 15:34:47.826933 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 332/658] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:34:47 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 15 15:34:47.830662 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-ca245ca6-b2a7-4b1a-b3a6-36d02e4dc657 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '.version_select at 0x7fe3c6824ca0>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:34:47.859252 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-ca245ca6-b2a7-4b1a-b3a6-36d02e4dc657 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-533294991" status: 204 len: 0 microversion: 2.20 time: 0.034783 Jul 15 15:34:47.859815 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 327/659] 10.222.0.40 () {60 vars in 1258 bytes} [Fri Jul 15 15:34:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-533294991 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 15 15:34:48.695791 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7ce2641e-90a2-48ef-bc55-4c82d247be5b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Action: 'create', calling method: .version_select at 0x7fe3c670b310>, body: {"keypair": {"name": "tempest-keypair-1968229912", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/c4PWfJxUXj1eqHiFFiF9TiBAQ+xIoNyvmA9wXyCBEduEXcL0GjQIVLUoetsYBI9AbKKXcVwCZOB7xakmMgJMuX9aSTYHV43PIt17orVSryX3ZlJe28Aoy08gIPM/i2g=="}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:34:48.714405 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-7ce2641e-90a2-48ef-bc55-4c82d247be5b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Getting quotas for project 83cbbde066834f25a1b6f1bdc28e8b79. Resources: {'key_pairs'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:34:48.719252 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-7ce2641e-90a2-48ef-bc55-4c82d247be5b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Getting quotas for user 9a0d49b3b50b4e668e157cb2e8e47da2 and project 83cbbde066834f25a1b6f1bdc28e8b79. Resources: {'key_pairs'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:34:48.749751 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7ce2641e-90a2-48ef-bc55-4c82d247be5b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.058043 Jul 15 15:34:48.750389 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 333/660] 10.222.0.40 () {62 vars in 1199 bytes} [Fri Jul 15 15:34:48 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 15 15:34:50.288581 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-274b30c1-017b-4b98-bf19-54e3aa3ab559 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-294888126", "imageRef": "b9770891-ef3b-4f53-a989-3a4db420d5c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3a5f9cec-c0c2-4330-acd4-167ce1985800"}], "security_groups": [{"name": "tempest-securitygroup--1700348441"}], "key_name": "tempest-keypair-1968229912", "user_data": "}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:34:50.396749 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.network.neutron [None req-274b30c1-017b-4b98-bf19-54e3aa3ab559 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] validate_networks() for [('3a5f9cec-c0c2-4330-acd4-167ce1985800', None, None, None, None, None)] {{(pid=117999) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:34:50.875324 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-274b30c1-017b-4b98-bf19-54e3aa3ab559 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Flavor limits 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:34:50.875749 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-274b30c1-017b-4b98-bf19-54e3aa3ab559 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Image limits 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:34:50.876219 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-274b30c1-017b-4b98-bf19-54e3aa3ab559 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Flavor pref 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:34:50.876665 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-274b30c1-017b-4b98-bf19-54e3aa3ab559 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Image pref 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:34:50.877104 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-274b30c1-017b-4b98-bf19-54e3aa3ab559 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:34:50.888021 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-274b30c1-017b-4b98-bf19-54e3aa3ab559 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:50.888462 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-274b30c1-017b-4b98-bf19-54e3aa3ab559 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:50.889338 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-274b30c1-017b-4b98-bf19-54e3aa3ab559 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:50.890111 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-274b30c1-017b-4b98-bf19-54e3aa3ab559 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:50.910554 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-274b30c1-017b-4b98-bf19-54e3aa3ab559 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Getting quotas for project 83cbbde066834f25a1b6f1bdc28e8b79. Resources: {'ram', 'instances', 'cores'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:34:50.916097 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-274b30c1-017b-4b98-bf19-54e3aa3ab559 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Getting quotas for user 9a0d49b3b50b4e668e157cb2e8e47da2 and project 83cbbde066834f25a1b6f1bdc28e8b79. Resources: {'ram', 'instances', 'cores'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:34:50.930900 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-274b30c1-017b-4b98-bf19-54e3aa3ab559 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Going to run 1 instances... {{(pid=117999) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:34:50.933614 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-274b30c1-017b-4b98-bf19-54e3aa3ab559 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9770891-ef3b-4f53-a989-3a4db420d5c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117999) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:34:51.007886 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR oslo.messaging._drivers.impl_rabbit [None req-274b30c1-017b-4b98-bf19-54e3aa3ab559 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [c661639d-5269-420e-9be8-a7e23aac6351] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 15 15:34:52.016707 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO oslo.messaging._drivers.impl_rabbit [None req-274b30c1-017b-4b98-bf19-54e3aa3ab559 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [c661639d-5269-420e-9be8-a7e23aac6351] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 42524. Jul 15 15:34:52.021717 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-274b30c1-017b-4b98-bf19-54e3aa3ab559 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.737914 Jul 15 15:34:52.022468 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 328/661] 10.222.0.40 () {62 vars in 1187 bytes} [Fri Jul 15 15:34:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 1742 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 15 15:34:52.036713 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-05190c14-0ea0-4bc1-bcf0-3ea38a0b907b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:34:52.037582 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-05190c14-0ea0-4bc1-bcf0-3ea38a0b907b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:34:52.102175 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-05190c14-0ea0-4bc1-bcf0-3ea38a0b907b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:52.111377 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-05190c14-0ea0-4bc1-bcf0-3ea38a0b907b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:52.113077 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-05190c14-0ea0-4bc1-bcf0-3ea38a0b907b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:52.113974 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-05190c14-0ea0-4bc1-bcf0-3ea38a0b907b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1281 microversion: 2.20 time: 0.083531 Jul 15 15:34:52.114551 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 334/662] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:34:52 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1281 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:34:53.133992 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-c7f1e945-0dc3-47ce-8e42-313755fcd28e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:34:53.134889 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-c7f1e945-0dc3-47ce-8e42-313755fcd28e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:34:53.194402 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-c7f1e945-0dc3-47ce-8e42-313755fcd28e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:53.205434 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-c7f1e945-0dc3-47ce-8e42-313755fcd28e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:53.208150 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-c7f1e945-0dc3-47ce-8e42-313755fcd28e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:53.210117 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-c7f1e945-0dc3-47ce-8e42-313755fcd28e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1281 microversion: 2.20 time: 0.080409 Jul 15 15:34:53.211114 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 329/663] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:34:53 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1281 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:34:54.231603 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d30be6bb-754a-436c-93bb-3a2fe7c0493a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:34:54.232393 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d30be6bb-754a-436c-93bb-3a2fe7c0493a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:34:54.312485 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d30be6bb-754a-436c-93bb-3a2fe7c0493a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:54.322310 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d30be6bb-754a-436c-93bb-3a2fe7c0493a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:54.323904 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d30be6bb-754a-436c-93bb-3a2fe7c0493a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:54.325284 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d30be6bb-754a-436c-93bb-3a2fe7c0493a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1281 microversion: 2.20 time: 0.099384 Jul 15 15:34:54.327041 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 335/664] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:34:54 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1281 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:34:55.345891 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-b555788c-fcd6-46ba-9d02-d90fa669102f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:34:55.347179 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-b555788c-fcd6-46ba-9d02-d90fa669102f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:34:55.405696 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b555788c-fcd6-46ba-9d02-d90fa669102f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:55.413604 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b555788c-fcd6-46ba-9d02-d90fa669102f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:55.415540 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b555788c-fcd6-46ba-9d02-d90fa669102f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:55.416578 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-b555788c-fcd6-46ba-9d02-d90fa669102f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1281 microversion: 2.20 time: 0.075605 Jul 15 15:34:55.417106 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 330/665] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:34:55 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:34:56.439220 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-edfaebf8-38da-4b4d-b98b-df0be46db1d6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:34:56.439829 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-edfaebf8-38da-4b4d-b98b-df0be46db1d6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:34:56.447076 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-edfaebf8-38da-4b4d-b98b-df0be46db1d6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:56.447519 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-edfaebf8-38da-4b4d-b98b-df0be46db1d6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:56.448287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-edfaebf8-38da-4b4d-b98b-df0be46db1d6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:56.448692 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-edfaebf8-38da-4b4d-b98b-df0be46db1d6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:56.525131 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-edfaebf8-38da-4b4d-b98b-df0be46db1d6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:56.535256 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-edfaebf8-38da-4b4d-b98b-df0be46db1d6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:56.537135 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-edfaebf8-38da-4b4d-b98b-df0be46db1d6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:56.538264 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-edfaebf8-38da-4b4d-b98b-df0be46db1d6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1285 microversion: 2.20 time: 0.103648 Jul 15 15:34:56.538859 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 336/666] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:34:56 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:34:57.562058 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-b1374483-e3b6-4bd5-8038-96f7dee6c49b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:34:57.563081 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-b1374483-e3b6-4bd5-8038-96f7dee6c49b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:34:57.574433 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b1374483-e3b6-4bd5-8038-96f7dee6c49b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:57.575228 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b1374483-e3b6-4bd5-8038-96f7dee6c49b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:57.576659 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b1374483-e3b6-4bd5-8038-96f7dee6c49b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:57.577409 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b1374483-e3b6-4bd5-8038-96f7dee6c49b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:57.662673 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b1374483-e3b6-4bd5-8038-96f7dee6c49b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:57.677718 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b1374483-e3b6-4bd5-8038-96f7dee6c49b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:57.680616 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b1374483-e3b6-4bd5-8038-96f7dee6c49b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:57.682629 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-b1374483-e3b6-4bd5-8038-96f7dee6c49b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1339 microversion: 2.20 time: 0.127732 Jul 15 15:34:57.683583 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 331/667] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:34:57 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1339 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:34:58.704861 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9446104f-67e4-4c76-b3da-0032518dce9a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:34:58.705666 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9446104f-67e4-4c76-b3da-0032518dce9a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:34:58.713718 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9446104f-67e4-4c76-b3da-0032518dce9a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:58.714132 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9446104f-67e4-4c76-b3da-0032518dce9a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:58.714998 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9446104f-67e4-4c76-b3da-0032518dce9a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:58.715424 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9446104f-67e4-4c76-b3da-0032518dce9a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:58.961417 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9446104f-67e4-4c76-b3da-0032518dce9a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:58.980132 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9446104f-67e4-4c76-b3da-0032518dce9a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:58.983569 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9446104f-67e4-4c76-b3da-0032518dce9a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:34:58.994702 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9446104f-67e4-4c76-b3da-0032518dce9a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1407 microversion: 2.20 time: 0.294380 Jul 15 15:34:58.996064 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 337/668] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:34:58 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1407 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:34:59.233365 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-99b54729-2a28-430b-9637-250283e0f914 req-d13cd71d-afdb-4b86-8ff0-743980089a98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a2a79d6-dd6d-4d59-a58c-11252d834add", "tag": "06b33828-c90f-45fb-839b-8fd1808f8a80"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:34:59.255400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-99b54729-2a28-430b-9637-250283e0f914 req-d13cd71d-afdb-4b86-8ff0-743980089a98 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:34:59.256663 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-99b54729-2a28-430b-9637-250283e0f914 req-d13cd71d-afdb-4b86-8ff0-743980089a98 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:34:59.279711 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-99b54729-2a28-430b-9637-250283e0f914 req-d13cd71d-afdb-4b86-8ff0-743980089a98 service nova] Creating event network-changed:06b33828-c90f-45fb-839b-8fd1808f8a80 for instance 0a2a79d6-dd6d-4d59-a58c-11252d834add on hv-cinder-85001 Jul 15 15:34:59.285865 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-99b54729-2a28-430b-9637-250283e0f914 req-d13cd71d-afdb-4b86-8ff0-743980089a98 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061535 Jul 15 15:34:59.287181 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 332/669] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:35:00.021290 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4aa6468e-0fc5-488c-bc87-59b6d4e2ff6a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:00.021899 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-4aa6468e-0fc5-488c-bc87-59b6d4e2ff6a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:00.029069 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4aa6468e-0fc5-488c-bc87-59b6d4e2ff6a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:00.029731 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4aa6468e-0fc5-488c-bc87-59b6d4e2ff6a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:00.030751 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4aa6468e-0fc5-488c-bc87-59b6d4e2ff6a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:00.031186 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4aa6468e-0fc5-488c-bc87-59b6d4e2ff6a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:00.190987 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-4aa6468e-0fc5-488c-bc87-59b6d4e2ff6a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:00.200121 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-4aa6468e-0fc5-488c-bc87-59b6d4e2ff6a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:00.202057 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-4aa6468e-0fc5-488c-bc87-59b6d4e2ff6a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:00.203232 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4aa6468e-0fc5-488c-bc87-59b6d4e2ff6a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1407 microversion: 2.20 time: 0.186966 Jul 15 15:35:00.203799 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 338/670] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:35:00 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:35:00.917648 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=2 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:35:00.922942 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-b2ee8150-9656-4aa6-99fc-7a5ed7676881 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:00.923573 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-b2ee8150-9656-4aa6-99fc-7a5ed7676881 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:00.930638 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b2ee8150-9656-4aa6-99fc-7a5ed7676881 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:00.931078 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b2ee8150-9656-4aa6-99fc-7a5ed7676881 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:00.931847 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b2ee8150-9656-4aa6-99fc-7a5ed7676881 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:00.932272 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b2ee8150-9656-4aa6-99fc-7a5ed7676881 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:01.028420 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.objects.instance [None req-b2ee8150-9656-4aa6-99fc-7a5ed7676881 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lazy-loading 'services' on Instance uuid 5eead4bb-c878-4229-b3fc-85f35ec8c5f8 {{(pid=117999) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:35:01.109492 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-b2ee8150-9656-4aa6-99fc-7a5ed7676881 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8/os-volume_attachments/6373bd49-176a-477f-b54c-32e42dac79fd" status: 202 len: 0 microversion: 2.1 time: 0.192967 Jul 15 15:35:01.109976 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 333/671] 10.222.0.40 () {58 vars in 1415 bytes} [Fri Jul 15 15:35:00 2022] DELETE /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8/os-volume_attachments/6373bd49-176a-477f-b54c-32e42dac79fd => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 15:35:01.119247 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7046798b-7f9a-4236-818e-ea8c4e9814af tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:01.120164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7046798b-7f9a-4236-818e-ea8c4e9814af tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:01.126759 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7046798b-7f9a-4236-818e-ea8c4e9814af tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:01.127194 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7046798b-7f9a-4236-818e-ea8c4e9814af tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:01.127943 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7046798b-7f9a-4236-818e-ea8c4e9814af tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:01.128361 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7046798b-7f9a-4236-818e-ea8c4e9814af tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:01.161429 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7046798b-7f9a-4236-818e-ea8c4e9814af tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046547 Jul 15 15:35:01.161999 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 339/672] 10.222.0.40 () {58 vars in 1301 bytes} [Fri Jul 15 15:35:01 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:35:01.221819 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-811fa8bc-d100-46c6-a782-589008dd36b6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:01.222510 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-811fa8bc-d100-46c6-a782-589008dd36b6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:01.229353 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-811fa8bc-d100-46c6-a782-589008dd36b6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:01.229796 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-811fa8bc-d100-46c6-a782-589008dd36b6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:01.230572 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-811fa8bc-d100-46c6-a782-589008dd36b6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:01.231016 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-811fa8bc-d100-46c6-a782-589008dd36b6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:01.378226 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-811fa8bc-d100-46c6-a782-589008dd36b6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:01.386535 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-811fa8bc-d100-46c6-a782-589008dd36b6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:01.388067 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-811fa8bc-d100-46c6-a782-589008dd36b6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:01.389211 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-811fa8bc-d100-46c6-a782-589008dd36b6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1407 microversion: 2.20 time: 0.171846 Jul 15 15:35:01.389764 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 334/673] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:35:01 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:35:02.173352 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6681bc09-bc27-482b-9119-9d7c3b1d48df tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:02.174581 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6681bc09-bc27-482b-9119-9d7c3b1d48df tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:02.181532 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6681bc09-bc27-482b-9119-9d7c3b1d48df tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:02.182015 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6681bc09-bc27-482b-9119-9d7c3b1d48df tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:02.182940 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6681bc09-bc27-482b-9119-9d7c3b1d48df tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:02.183411 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6681bc09-bc27-482b-9119-9d7c3b1d48df tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:02.217503 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6681bc09-bc27-482b-9119-9d7c3b1d48df tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048283 Jul 15 15:35:02.218215 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 340/674] 10.222.0.40 () {58 vars in 1301 bytes} [Fri Jul 15 15:35:02 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:35:02.412423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-b26f0e8d-b4f0-4906-915e-8a747aa36c8e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:02.413769 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-b26f0e8d-b4f0-4906-915e-8a747aa36c8e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:02.426696 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b26f0e8d-b4f0-4906-915e-8a747aa36c8e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:02.427587 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b26f0e8d-b4f0-4906-915e-8a747aa36c8e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:02.427902 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b26f0e8d-b4f0-4906-915e-8a747aa36c8e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:02.428819 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b26f0e8d-b4f0-4906-915e-8a747aa36c8e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:02.649185 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b26f0e8d-b4f0-4906-915e-8a747aa36c8e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:02.657789 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b26f0e8d-b4f0-4906-915e-8a747aa36c8e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:02.659368 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b26f0e8d-b4f0-4906-915e-8a747aa36c8e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:02.660482 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-b26f0e8d-b4f0-4906-915e-8a747aa36c8e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1407 microversion: 2.20 time: 0.255897 Jul 15 15:35:02.661043 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 335/675] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:35:02 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:35:03.234146 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a8303fdb-2c27-4904-a75e-7d75d59f30ad tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:03.235751 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a8303fdb-2c27-4904-a75e-7d75d59f30ad tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:03.245252 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a8303fdb-2c27-4904-a75e-7d75d59f30ad tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:03.246337 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a8303fdb-2c27-4904-a75e-7d75d59f30ad tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:03.247970 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a8303fdb-2c27-4904-a75e-7d75d59f30ad tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:03.248731 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a8303fdb-2c27-4904-a75e-7d75d59f30ad tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:03.281627 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a8303fdb-2c27-4904-a75e-7d75d59f30ad tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051668 Jul 15 15:35:03.283506 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 341/676] 10.222.0.40 () {58 vars in 1301 bytes} [Fri Jul 15 15:35:03 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:35:03.682391 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-8812fcbf-b6e6-4309-b8e5-c22ad77719d4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:03.683322 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-8812fcbf-b6e6-4309-b8e5-c22ad77719d4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:03.690296 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8812fcbf-b6e6-4309-b8e5-c22ad77719d4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:03.690767 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8812fcbf-b6e6-4309-b8e5-c22ad77719d4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:03.691531 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8812fcbf-b6e6-4309-b8e5-c22ad77719d4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:03.691951 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8812fcbf-b6e6-4309-b8e5-c22ad77719d4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:03.865954 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-8812fcbf-b6e6-4309-b8e5-c22ad77719d4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:03.878718 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-8812fcbf-b6e6-4309-b8e5-c22ad77719d4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:03.881231 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-8812fcbf-b6e6-4309-b8e5-c22ad77719d4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:03.883087 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-8812fcbf-b6e6-4309-b8e5-c22ad77719d4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1407 microversion: 2.20 time: 0.207556 Jul 15 15:35:03.884237 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 336/677] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:35:03 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:35:04.299044 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c573a36e-58c4-4a79-b93b-2803a129c477 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:04.300499 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-c573a36e-58c4-4a79-b93b-2803a129c477 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:04.310779 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c573a36e-58c4-4a79-b93b-2803a129c477 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:04.311274 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c573a36e-58c4-4a79-b93b-2803a129c477 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:04.312265 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c573a36e-58c4-4a79-b93b-2803a129c477 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:04.312951 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c573a36e-58c4-4a79-b93b-2803a129c477 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:04.318232 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=8 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:35:04.352410 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-c573a36e-58c4-4a79-b93b-2803a129c477 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060592 Jul 15 15:35:04.353402 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 342/678] 10.222.0.40 () {58 vars in 1301 bytes} [Fri Jul 15 15:35:04 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 15:35:04.453269 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-4820481d-86c0-4297-b348-8e4e61b0ddcd tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:04.453806 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-4820481d-86c0-4297-b348-8e4e61b0ddcd tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:04.460409 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4820481d-86c0-4297-b348-8e4e61b0ddcd tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:04.460879 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4820481d-86c0-4297-b348-8e4e61b0ddcd tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:04.461642 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4820481d-86c0-4297-b348-8e4e61b0ddcd tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:04.462067 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4820481d-86c0-4297-b348-8e4e61b0ddcd tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:04.488368 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-4820481d-86c0-4297-b348-8e4e61b0ddcd tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Going to try to terminate instance {{(pid=117999) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 15:35:04.588275 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-4820481d-86c0-4297-b348-8e4e61b0ddcd tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 204 len: 0 microversion: 2.1 time: 0.138254 Jul 15 15:35:04.589060 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 337/679] 10.222.0.40 () {58 vars in 1238 bytes} [Fri Jul 15 15:35:04 2022] DELETE /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:35:04.600375 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d8b25a85-8fa4-489d-bdab-6533e55c3123 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:04.600898 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d8b25a85-8fa4-489d-bdab-6533e55c3123 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:04.608003 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d8b25a85-8fa4-489d-bdab-6533e55c3123 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:04.608477 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d8b25a85-8fa4-489d-bdab-6533e55c3123 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:04.609314 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d8b25a85-8fa4-489d-bdab-6533e55c3123 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:04.609953 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d8b25a85-8fa4-489d-bdab-6533e55c3123 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:04.758631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d8b25a85-8fa4-489d-bdab-6533e55c3123 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:04.766437 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d8b25a85-8fa4-489d-bdab-6533e55c3123 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1691 microversion: 2.1 time: 0.171987 Jul 15 15:35:04.767044 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 343/680] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:04 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:35:04.902636 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-37d81bab-2a64-4e1e-9bad-deb60e8523c1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:04.903195 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-37d81bab-2a64-4e1e-9bad-deb60e8523c1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:04.912681 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-37d81bab-2a64-4e1e-9bad-deb60e8523c1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:04.913428 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-37d81bab-2a64-4e1e-9bad-deb60e8523c1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:04.914788 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-37d81bab-2a64-4e1e-9bad-deb60e8523c1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:04.915646 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-37d81bab-2a64-4e1e-9bad-deb60e8523c1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:05.081460 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-37d81bab-2a64-4e1e-9bad-deb60e8523c1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:05.091602 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-37d81bab-2a64-4e1e-9bad-deb60e8523c1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:05.093616 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-37d81bab-2a64-4e1e-9bad-deb60e8523c1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:05.095138 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-37d81bab-2a64-4e1e-9bad-deb60e8523c1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1407 microversion: 2.20 time: 0.196927 Jul 15 15:35:05.096092 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 338/681] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:35:04 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:35:05.200350 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-1802fe0f-1886-4a98-a864-7b2e6b9e5321 req-c0102cad-fa19-42e2-b626-1b8f2968365e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a2a79d6-dd6d-4d59-a58c-11252d834add", "name": "network-vif-plugged", "status": "completed", "tag": "06b33828-c90f-45fb-839b-8fd1808f8a80"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:35:05.212477 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-1802fe0f-1886-4a98-a864-7b2e6b9e5321 req-c0102cad-fa19-42e2-b626-1b8f2968365e service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:05.212905 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-1802fe0f-1886-4a98-a864-7b2e6b9e5321 req-c0102cad-fa19-42e2-b626-1b8f2968365e service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:05.225660 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-1802fe0f-1886-4a98-a864-7b2e6b9e5321 req-c0102cad-fa19-42e2-b626-1b8f2968365e service nova] Creating event network-vif-plugged:06b33828-c90f-45fb-839b-8fd1808f8a80 for instance 0a2a79d6-dd6d-4d59-a58c-11252d834add on hv-cinder-85001 Jul 15 15:35:05.230951 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-1802fe0f-1886-4a98-a864-7b2e6b9e5321 req-c0102cad-fa19-42e2-b626-1b8f2968365e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037701 Jul 15 15:35:05.231545 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 344/682] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:35:05.784789 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-03125ca3-99f3-480d-b6c7-d2bd68642133 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:05.785399 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-03125ca3-99f3-480d-b6c7-d2bd68642133 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:05.787470 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=10 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:35:05.793394 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-03125ca3-99f3-480d-b6c7-d2bd68642133 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:05.793837 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-03125ca3-99f3-480d-b6c7-d2bd68642133 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:05.794636 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-03125ca3-99f3-480d-b6c7-d2bd68642133 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:05.795213 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-03125ca3-99f3-480d-b6c7-d2bd68642133 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:05.817336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:35:05.947791 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-03125ca3-99f3-480d-b6c7-d2bd68642133 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:05.956359 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-03125ca3-99f3-480d-b6c7-d2bd68642133 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1691 microversion: 2.1 time: 0.176458 Jul 15 15:35:05.956955 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 339/683] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:05 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:35:06.115372 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-92cdd9f2-afcd-4a81-8d01-05284282108f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:06.116065 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-92cdd9f2-afcd-4a81-8d01-05284282108f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:06.123003 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-92cdd9f2-afcd-4a81-8d01-05284282108f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:06.123440 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-92cdd9f2-afcd-4a81-8d01-05284282108f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:06.124195 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-92cdd9f2-afcd-4a81-8d01-05284282108f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:06.124592 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-92cdd9f2-afcd-4a81-8d01-05284282108f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:06.271773 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-92cdd9f2-afcd-4a81-8d01-05284282108f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:06.281562 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-92cdd9f2-afcd-4a81-8d01-05284282108f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:06.283938 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-92cdd9f2-afcd-4a81-8d01-05284282108f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:06.285122 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-92cdd9f2-afcd-4a81-8d01-05284282108f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1407 microversion: 2.20 time: 0.175272 Jul 15 15:35:06.285821 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 345/684] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:35:06 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:35:06.980909 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-c5cd5791-838e-48ee-8bad-cb1419de50c2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:06.981679 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-c5cd5791-838e-48ee-8bad-cb1419de50c2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:06.988629 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c5cd5791-838e-48ee-8bad-cb1419de50c2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:06.989386 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c5cd5791-838e-48ee-8bad-cb1419de50c2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:06.990152 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c5cd5791-838e-48ee-8bad-cb1419de50c2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:06.990621 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c5cd5791-838e-48ee-8bad-cb1419de50c2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:07.142587 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-c5cd5791-838e-48ee-8bad-cb1419de50c2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:07.153884 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-c5cd5791-838e-48ee-8bad-cb1419de50c2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1691 microversion: 2.1 time: 0.178355 Jul 15 15:35:07.154916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 340/685] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:06 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1691 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:35:07.304661 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9e896928-e2b8-480f-a3f6-22bbb1b9e520 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:07.305293 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9e896928-e2b8-480f-a3f6-22bbb1b9e520 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:07.317437 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9e896928-e2b8-480f-a3f6-22bbb1b9e520 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:07.319213 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9e896928-e2b8-480f-a3f6-22bbb1b9e520 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:07.320570 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9e896928-e2b8-480f-a3f6-22bbb1b9e520 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:07.321823 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9e896928-e2b8-480f-a3f6-22bbb1b9e520 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:07.531350 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9e896928-e2b8-480f-a3f6-22bbb1b9e520 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:07.536343 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:35:07.542378 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9e896928-e2b8-480f-a3f6-22bbb1b9e520 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:07.543913 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9e896928-e2b8-480f-a3f6-22bbb1b9e520 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:07.545029 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9e896928-e2b8-480f-a3f6-22bbb1b9e520 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1407 microversion: 2.20 time: 0.244581 Jul 15 15:35:07.545598 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 346/686] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:35:07 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:35:08.177945 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-55de8000-882c-4c1f-b5d2-ac1fccec0b53 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:08.179183 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-55de8000-882c-4c1f-b5d2-ac1fccec0b53 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:08.187594 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-55de8000-882c-4c1f-b5d2-ac1fccec0b53 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:08.188024 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-55de8000-882c-4c1f-b5d2-ac1fccec0b53 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:08.188784 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-55de8000-882c-4c1f-b5d2-ac1fccec0b53 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:08.189245 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-55de8000-882c-4c1f-b5d2-ac1fccec0b53 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:08.346103 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-55de8000-882c-4c1f-b5d2-ac1fccec0b53 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:08.359629 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-55de8000-882c-4c1f-b5d2-ac1fccec0b53 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1691 microversion: 2.1 time: 0.186596 Jul 15 15:35:08.360626 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 341/687] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:08 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1691 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:35:08.564365 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3b738c35-7172-4b00-b0e2-2d4e089c7ca9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:08.565393 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3b738c35-7172-4b00-b0e2-2d4e089c7ca9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:08.574046 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3b738c35-7172-4b00-b0e2-2d4e089c7ca9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:08.574493 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3b738c35-7172-4b00-b0e2-2d4e089c7ca9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:08.575298 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3b738c35-7172-4b00-b0e2-2d4e089c7ca9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:08.575732 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3b738c35-7172-4b00-b0e2-2d4e089c7ca9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:08.724325 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3b738c35-7172-4b00-b0e2-2d4e089c7ca9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:08.735759 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3b738c35-7172-4b00-b0e2-2d4e089c7ca9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:08.737389 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3b738c35-7172-4b00-b0e2-2d4e089c7ca9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:08.738489 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3b738c35-7172-4b00-b0e2-2d4e089c7ca9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1407 microversion: 2.20 time: 0.178368 Jul 15 15:35:08.739097 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 347/688] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:35:08 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:35:09.013156 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-d8cef6f5-cbc9-458d-bbda-716fab01deb5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:09.014247 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-d8cef6f5-cbc9-458d-bbda-716fab01deb5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:09.022091 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d8cef6f5-cbc9-458d-bbda-716fab01deb5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:09.022566 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d8cef6f5-cbc9-458d-bbda-716fab01deb5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:09.023588 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d8cef6f5-cbc9-458d-bbda-716fab01deb5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:09.024039 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d8cef6f5-cbc9-458d-bbda-716fab01deb5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:09.058731 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-d8cef6f5-cbc9-458d-bbda-716fab01deb5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049424 Jul 15 15:35:09.059311 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 342/689] 10.222.0.40 () {58 vars in 1301 bytes} [Fri Jul 15 15:35:09 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 15:35:09.131766 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8ffb2a03-0b4f-4303-9cde-111f4f61a082 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:09.132275 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8ffb2a03-0b4f-4303-9cde-111f4f61a082 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:09.139697 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8ffb2a03-0b4f-4303-9cde-111f4f61a082 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:09.139697 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8ffb2a03-0b4f-4303-9cde-111f4f61a082 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:09.140423 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8ffb2a03-0b4f-4303-9cde-111f4f61a082 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:09.140835 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8ffb2a03-0b4f-4303-9cde-111f4f61a082 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:09.175888 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8ffb2a03-0b4f-4303-9cde-111f4f61a082 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Going to try to terminate instance {{(pid=117998) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 15:35:09.271129 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8ffb2a03-0b4f-4303-9cde-111f4f61a082 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 204 len: 0 microversion: 2.1 time: 0.142661 Jul 15 15:35:09.272220 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 348/690] 10.222.0.40 () {58 vars in 1238 bytes} [Fri Jul 15 15:35:09 2022] DELETE /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:35:09.282021 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3db94e7e-a0bd-4b13-9b6a-27cb243ac4e0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:09.282759 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-3db94e7e-a0bd-4b13-9b6a-27cb243ac4e0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:09.289914 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3db94e7e-a0bd-4b13-9b6a-27cb243ac4e0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:09.290425 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3db94e7e-a0bd-4b13-9b6a-27cb243ac4e0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:09.291283 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3db94e7e-a0bd-4b13-9b6a-27cb243ac4e0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:09.291799 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3db94e7e-a0bd-4b13-9b6a-27cb243ac4e0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:09.389433 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-61fda076-236b-4af2-b30a-a6fd41898b25 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:09.390114 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-61fda076-236b-4af2-b30a-a6fd41898b25 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:09.396825 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-61fda076-236b-4af2-b30a-a6fd41898b25 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:09.397499 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-61fda076-236b-4af2-b30a-a6fd41898b25 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:09.398305 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-61fda076-236b-4af2-b30a-a6fd41898b25 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:09.398757 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-61fda076-236b-4af2-b30a-a6fd41898b25 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:09.568206 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3db94e7e-a0bd-4b13-9b6a-27cb243ac4e0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:09.577387 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-3db94e7e-a0bd-4b13-9b6a-27cb243ac4e0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1673 microversion: 2.1 time: 0.299164 Jul 15 15:35:09.577965 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 343/691] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:09 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1673 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:35:09.687028 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-61fda076-236b-4af2-b30a-a6fd41898b25 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:09.716810 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-61fda076-236b-4af2-b30a-a6fd41898b25 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1691 microversion: 2.1 time: 0.331313 Jul 15 15:35:09.718537 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 349/692] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:09 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1691 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:35:09.765403 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-ab1d79f0-f56e-4e04-b8b6-4f383bb1cedc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:09.766488 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-ab1d79f0-f56e-4e04-b8b6-4f383bb1cedc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:09.775181 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ab1d79f0-f56e-4e04-b8b6-4f383bb1cedc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:09.776001 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ab1d79f0-f56e-4e04-b8b6-4f383bb1cedc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:09.777269 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ab1d79f0-f56e-4e04-b8b6-4f383bb1cedc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:09.777820 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ab1d79f0-f56e-4e04-b8b6-4f383bb1cedc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:10.036245 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-ab1d79f0-f56e-4e04-b8b6-4f383bb1cedc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:10.045000 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-ab1d79f0-f56e-4e04-b8b6-4f383bb1cedc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:10.046980 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-ab1d79f0-f56e-4e04-b8b6-4f383bb1cedc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:10.048454 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-ab1d79f0-f56e-4e04-b8b6-4f383bb1cedc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1407 microversion: 2.20 time: 0.293637 Jul 15 15:35:10.048956 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 344/693] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:35:09 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1407 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:35:10.142783 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-76417e15-759f-4575-bd0e-0115080fb629 req-a8285b71-6cec-4060-a1ac-a7c97b40bda6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eead4bb-c878-4229-b3fc-85f35ec8c5f8", "name": "network-vif-deleted", "tag": "680a99e9-4626-4827-a330-033935ba1c3c"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:35:10.151802 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-76417e15-759f-4575-bd0e-0115080fb629 req-a8285b71-6cec-4060-a1ac-a7c97b40bda6 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:10.152230 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-76417e15-759f-4575-bd0e-0115080fb629 req-a8285b71-6cec-4060-a1ac-a7c97b40bda6 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:10.165806 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-76417e15-759f-4575-bd0e-0115080fb629 req-a8285b71-6cec-4060-a1ac-a7c97b40bda6 service nova] Creating event network-vif-deleted:680a99e9-4626-4827-a330-033935ba1c3c for instance 5eead4bb-c878-4229-b3fc-85f35ec8c5f8 on hv-cinder-85001 Jul 15 15:35:10.173132 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-76417e15-759f-4575-bd0e-0115080fb629 req-a8285b71-6cec-4060-a1ac-a7c97b40bda6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033793 Jul 15 15:35:10.174140 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 350/694] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:35:10.600183 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-5911ff4b-923c-43b6-9d69-de2153e6f576 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:10.601169 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-5911ff4b-923c-43b6-9d69-de2153e6f576 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:10.608488 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5911ff4b-923c-43b6-9d69-de2153e6f576 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:10.608933 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5911ff4b-923c-43b6-9d69-de2153e6f576 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:10.609708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5911ff4b-923c-43b6-9d69-de2153e6f576 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:10.610132 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5911ff4b-923c-43b6-9d69-de2153e6f576 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:10.742155 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-dfc09e1b-f065-4c71-9d20-fd1dcf3f1292 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:10.743101 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-dfc09e1b-f065-4c71-9d20-fd1dcf3f1292 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:10.749895 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dfc09e1b-f065-4c71-9d20-fd1dcf3f1292 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:10.750344 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dfc09e1b-f065-4c71-9d20-fd1dcf3f1292 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:10.751147 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dfc09e1b-f065-4c71-9d20-fd1dcf3f1292 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:10.751576 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dfc09e1b-f065-4c71-9d20-fd1dcf3f1292 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:10.783690 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dfc09e1b-f065-4c71-9d20-fd1dcf3f1292 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:10.784383 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dfc09e1b-f065-4c71-9d20-fd1dcf3f1292 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:10.784842 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.objects.instance [None req-dfc09e1b-f065-4c71-9d20-fd1dcf3f1292 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lazy-loading 'fault' on Instance uuid 5eead4bb-c878-4229-b3fc-85f35ec8c5f8 {{(pid=117998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:35:10.802043 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-5911ff4b-923c-43b6-9d69-de2153e6f576 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:10.810025 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-5911ff4b-923c-43b6-9d69-de2153e6f576 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1673 microversion: 2.1 time: 0.216852 Jul 15 15:35:10.810617 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 345/695] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:10 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1673 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:35:10.856632 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-dfc09e1b-f065-4c71-9d20-fd1dcf3f1292 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:10.864570 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-dfc09e1b-f065-4c71-9d20-fd1dcf3f1292 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 200 len: 1336 microversion: 2.1 time: 0.128075 Jul 15 15:35:10.865239 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 351/696] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:10 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 1336 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:35:11.068605 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-1bd89306-9f9b-4dd9-b410-8a5844d07f59 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:11.069225 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-1bd89306-9f9b-4dd9-b410-8a5844d07f59 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:11.076496 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1bd89306-9f9b-4dd9-b410-8a5844d07f59 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:11.076943 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1bd89306-9f9b-4dd9-b410-8a5844d07f59 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:11.077720 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1bd89306-9f9b-4dd9-b410-8a5844d07f59 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:11.078125 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1bd89306-9f9b-4dd9-b410-8a5844d07f59 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:11.236489 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1bd89306-9f9b-4dd9-b410-8a5844d07f59 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:11.248515 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1bd89306-9f9b-4dd9-b410-8a5844d07f59 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:11.248515 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1bd89306-9f9b-4dd9-b410-8a5844d07f59 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:11.248861 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-1bd89306-9f9b-4dd9-b410-8a5844d07f59 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1600 microversion: 2.20 time: 0.184682 Jul 15 15:35:11.249438 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 346/697] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:35:11 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1600 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:35:11.267476 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-30e73316-ab7c-4461-9964-1e1fa323afa8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:11.268053 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-30e73316-ab7c-4461-9964-1e1fa323afa8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:11.270248 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:35:11.280970 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-30e73316-ab7c-4461-9964-1e1fa323afa8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:11.282341 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-30e73316-ab7c-4461-9964-1e1fa323afa8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:11.284005 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-30e73316-ab7c-4461-9964-1e1fa323afa8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:11.284786 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-30e73316-ab7c-4461-9964-1e1fa323afa8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:11.429164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-30e73316-ab7c-4461-9964-1e1fa323afa8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.164946 Jul 15 15:35:11.439884 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 352/698] 10.222.0.40 () {60 vars in 1315 bytes} [Fri Jul 15 15:35:11 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add/os-interface => generated 285 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:35:11.834203 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3564cf30-ab99-4930-849d-218afaa8cc5b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:11.835104 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-3564cf30-ab99-4930-849d-218afaa8cc5b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:11.837179 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:35:11.842245 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3564cf30-ab99-4930-849d-218afaa8cc5b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:11.842724 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3564cf30-ab99-4930-849d-218afaa8cc5b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:11.843962 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3564cf30-ab99-4930-849d-218afaa8cc5b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:11.843962 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3564cf30-ab99-4930-849d-218afaa8cc5b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:11.887893 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4a87a9ce-406f-4f61-b082-292e7d506257 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:11.890228 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-4a87a9ce-406f-4f61-b082-292e7d506257 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 5eead4bb-c878-4229-b3fc-85f35ec8c5f8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:11.901286 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4a87a9ce-406f-4f61-b082-292e7d506257 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:11.902140 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4a87a9ce-406f-4f61-b082-292e7d506257 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:11.903210 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4a87a9ce-406f-4f61-b082-292e7d506257 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:11.903863 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4a87a9ce-406f-4f61-b082-292e7d506257 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:11.920182 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-4a87a9ce-406f-4f61-b082-292e7d506257 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] HTTP exception thrown: Instance 5eead4bb-c878-4229-b3fc-85f35ec8c5f8 could not be found. Jul 15 15:35:11.922395 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4a87a9ce-406f-4f61-b082-292e7d506257 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Request method failure captured: Jul 15 15:35:11.922395 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 HTTP/1.1 Jul 15 15:35:11.922395 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:35:11.922395 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:35:11.922395 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:35:11.922395 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 15 15:35:11.922395 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:35:11.922395 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:35:11.922395 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:35:11.922395 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:35:11.922395 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0YcsFZkCZjkBbmSTXB7UwekvD5WNzeaEbNt0rITlIw_1hzYJxVEjCSvTE3Iz-khRfNW59h8CDuHoTt68mQeVPMhdAmhxbIqofx4vXjqK5T_vcExmq4CdFYJ8LNVUNZ_zMmgWfaeigTLlD9bCaozXsDQmwZpOGCKkhLeeXY2KxB1RuxI Jul 15 15:35:11.922395 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:35:11.922395 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:35:11.922395 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:35:11.922395 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:35:11.922395 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:35:11.922395 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:35:11.922395 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: 1e21747a454c4ebebb5d48b5906d5e5c Jul 15 15:35:11.922395 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2035142133 Jul 15 15:35:11.922395 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:35:11.922395 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:35:11.924264 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1e21747a454c4ebebb5d48b5906d5e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1e21747a454c4ebebb5d48b5906d5e5c", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1e21747a454c4ebebb5d48b5906d5e5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1e21747a454c4ebebb5d48b5906d5e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:35:11.924264 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2035142133 Jul 15 15:35:11.924264 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 1e21747a454c4ebebb5d48b5906d5e5c Jul 15 15:35:11.924264 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2035142133 Jul 15 15:35:11.924264 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-ServerRescueNegativeTestJSON-2035142133-project Jul 15 15:35:11.924264 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:35:11.924264 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:35:11.924264 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: c1a1af21d3f94b70a830b14200619f87 Jul 15 15:35:11.924264 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2035142133-project Jul 15 15:35:11.924264 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: > Jul 15 15:35:11.924264 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Instance 5eead4bb-c878-4229-b3fc-85f35ec8c5f8 could not be found. Jul 15 15:35:11.924264 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'id': '5eead4bb-c878-4229-b3fc-85f35ec8c5f8'} Jul 15 15:35:11.925492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:35:11.925492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:35:11.925492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:35:11.925492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:35:11.925492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:35:11.925492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:35:11.925492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:35:11.925492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:35:11.925492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:35:11.925492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:35:11.925492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eead4bb-c878-4229-b3fc-85f35ec8c5f8 could not be found. Jul 15 15:35:11.925492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:35:11.925492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:35:11.925492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:35:11.925492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:35:11.925492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:35:11.925492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:35:11.925492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:35:11.925492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:35:11.925492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:35:11.926816 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:35:11.926816 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:35:11.926816 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:35:11.926816 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:35:11.926816 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:35:11.926816 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:35:11.926816 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:35:11.926816 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eead4bb-c878-4229-b3fc-85f35ec8c5f8 could not be found. Jul 15 15:35:11.926816 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:35:11.926816 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:35:11.926816 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:35:11.926816 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:35:11.926816 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:35:11.926816 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:35:11.926816 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:35:11.926816 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:35:11.926816 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eead4bb-c878-4229-b3fc-85f35ec8c5f8 could not be found. Jul 15 15:35:11.926816 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:35:11.929528 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4a87a9ce-406f-4f61-b082-292e7d506257 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Returning 404 to user: Instance 5eead4bb-c878-4229-b3fc-85f35ec8c5f8 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:35:11.931203 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4a87a9ce-406f-4f61-b082-292e7d506257 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8" status: 404 len: 111 microversion: 2.1 time: 0.050351 Jul 15 15:35:11.932524 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 353/699] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:11 2022] GET /compute/v2.1/servers/5eead4bb-c878-4229-b3fc-85f35ec8c5f8 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:35:11.952337 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8459d717-ff65-49d1-a9fe-d865c7ecb62f tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '.version_select at 0x7fe3c67b9430>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:11.976300 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8459d717-ff65-49d1-a9fe-d865c7ecb62f tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1860053320" status: 202 len: 0 microversion: 2.1 time: 0.039115 Jul 15 15:35:11.976986 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 354/700] 10.222.0.40 () {58 vars in 1220 bytes} [Fri Jul 15 15:35:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1860053320 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:35:12.194374 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3564cf30-ab99-4930-849d-218afaa8cc5b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:12.210153 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-3564cf30-ab99-4930-849d-218afaa8cc5b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1673 microversion: 2.1 time: 0.379564 Jul 15 15:35:12.211699 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 347/701] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:11 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1673 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:35:12.932444 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-253862aa-794e-45d7-a248-848208672f16 req-d038f30f-a01d-463d-a40f-8f0c4cb50acc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a2a79d6-dd6d-4d59-a58c-11252d834add", "tag": "06b33828-c90f-45fb-839b-8fd1808f8a80"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:35:12.945531 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-253862aa-794e-45d7-a248-848208672f16 req-d038f30f-a01d-463d-a40f-8f0c4cb50acc service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:12.946371 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-253862aa-794e-45d7-a248-848208672f16 req-d038f30f-a01d-463d-a40f-8f0c4cb50acc service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:12.969255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-253862aa-794e-45d7-a248-848208672f16 req-d038f30f-a01d-463d-a40f-8f0c4cb50acc service nova] Creating event network-changed:06b33828-c90f-45fb-839b-8fd1808f8a80 for instance 0a2a79d6-dd6d-4d59-a58c-11252d834add on hv-cinder-85001 Jul 15 15:35:12.974816 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-253862aa-794e-45d7-a248-848208672f16 req-d038f30f-a01d-463d-a40f-8f0c4cb50acc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048654 Jul 15 15:35:12.975804 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 355/702] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:35:13.239969 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-c0e68f60-dd85-4636-8dca-147f0a902b16 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:13.241341 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-c0e68f60-dd85-4636-8dca-147f0a902b16 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:13.249452 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c0e68f60-dd85-4636-8dca-147f0a902b16 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:13.250076 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c0e68f60-dd85-4636-8dca-147f0a902b16 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:13.251787 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c0e68f60-dd85-4636-8dca-147f0a902b16 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:13.252265 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c0e68f60-dd85-4636-8dca-147f0a902b16 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:13.389096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-c0e68f60-dd85-4636-8dca-147f0a902b16 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:13.420192 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-c0e68f60-dd85-4636-8dca-147f0a902b16 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 200 len: 1605 microversion: 2.1 time: 0.191133 Jul 15 15:35:13.431925 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 348/703] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:13 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 1605 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:35:13.562853 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-c8ad8720-55ab-4428-9293-b2806525ac01 req-50a813da-3ee8-46c2-9a82-e42ac36b2cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d95c0294-3423-429b-8bcf-43e2089fca23", "name": "network-vif-deleted", "tag": "342c12f2-654f-4608-be83-59dbef84ae43"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:35:13.586577 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-c8ad8720-55ab-4428-9293-b2806525ac01 req-50a813da-3ee8-46c2-9a82-e42ac36b2cc7 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:13.587797 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-c8ad8720-55ab-4428-9293-b2806525ac01 req-50a813da-3ee8-46c2-9a82-e42ac36b2cc7 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:13.640531 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-c8ad8720-55ab-4428-9293-b2806525ac01 req-50a813da-3ee8-46c2-9a82-e42ac36b2cc7 service nova] Creating event network-vif-deleted:342c12f2-654f-4608-be83-59dbef84ae43 for instance d95c0294-3423-429b-8bcf-43e2089fca23 on hv-cinder-85001 Jul 15 15:35:13.662035 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-c8ad8720-55ab-4428-9293-b2806525ac01 req-50a813da-3ee8-46c2-9a82-e42ac36b2cc7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110930 Jul 15 15:35:13.664313 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 356/704] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:35:14.445096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-069a7b65-6f26-43a8-acae-6a2e9818aeb0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:14.446328 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-069a7b65-6f26-43a8-acae-6a2e9818aeb0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:14.455964 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-069a7b65-6f26-43a8-acae-6a2e9818aeb0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:14.456410 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-069a7b65-6f26-43a8-acae-6a2e9818aeb0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:14.457316 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-069a7b65-6f26-43a8-acae-6a2e9818aeb0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:14.457754 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-069a7b65-6f26-43a8-acae-6a2e9818aeb0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:14.474047 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.wsgi [None req-069a7b65-6f26-43a8-acae-6a2e9818aeb0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] HTTP exception thrown: Instance d95c0294-3423-429b-8bcf-43e2089fca23 could not be found. Jul 15 15:35:14.476415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-069a7b65-6f26-43a8-acae-6a2e9818aeb0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Request method failure captured: Jul 15 15:35:14.476415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: request: GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 HTTP/1.1 Jul 15 15:35:14.476415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept: application/json Jul 15 15:35:14.476415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept-Encoding: identity Jul 15 15:35:14.476415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Connection: close Jul 15 15:35:14.476415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Length: 0 Jul 15 15:35:14.476415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Type: application/json Jul 15 15:35:14.476415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Host: 10.222.0.40 Jul 15 15:35:14.476415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Openstack-System-Scope: None Jul 15 15:35:14.476415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: User-Agent: python-urllib3/1.26.9 Jul 15 15:35:14.476415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Auth-Token: gAAAAABi0Yckp5Reo958jqWzEgIN8s3AU2dJ8n9AMZ4ulj1WZfgX5jzlZ9cFiMcalRcGgcajsHRFQ7WDXDODtWYNqfTYf82aXvcljyf8OGOGPBqc3l_ZRDNfUMvSgy6ai9BX7LcxBLPS4Jepq_tVvIpCR4Mmf1B7FUYtZTBUGt8amEngd3wLfZ0 Jul 15 15:35:14.476415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Id: None Jul 15 15:35:14.476415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Name: None Jul 15 15:35:14.476415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Identity-Status: Confirmed Jul 15 15:35:14.476415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Is-Admin-Project: True Jul 15 15:35:14.476415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Id: default Jul 15 15:35:14.476415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Name: Default Jul 15 15:35:14.476415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Id: 5e51044e804442909f18288b9a6430a5 Jul 15 15:35:14.476415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Name: tempest-AttachVolumeTestJSON-1197345005 Jul 15 15:35:14.476415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Role: member,reader Jul 15 15:35:14.476415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Roles: member,reader Jul 15 15:35:14.484833 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5e51044e804442909f18288b9a6430a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5e51044e804442909f18288b9a6430a5", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5e51044e804442909f18288b9a6430a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5e51044e804442909f18288b9a6430a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:35:14.484833 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant: tempest-AttachVolumeTestJSON-1197345005 Jul 15 15:35:14.484833 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Id: 5e51044e804442909f18288b9a6430a5 Jul 15 15:35:14.484833 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1197345005 Jul 15 15:35:14.484833 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User: tempest-AttachVolumeTestJSON-1197345005-project Jul 15 15:35:14.484833 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Id: default Jul 15 15:35:14.484833 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Name: Default Jul 15 15:35:14.484833 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Id: 08050c1635084492a4b054b172884af8 Jul 15 15:35:14.484833 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Name: tempest-AttachVolumeTestJSON-1197345005-project Jul 15 15:35:14.484833 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: method: > Jul 15 15:35:14.484833 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: exception: Instance d95c0294-3423-429b-8bcf-43e2089fca23 could not be found. Jul 15 15:35:14.484833 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: action_args: {'id': 'd95c0294-3423-429b-8bcf-43e2089fca23'} Jul 15 15:35:14.488020 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:35:14.488020 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:35:14.488020 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:35:14.488020 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:35:14.488020 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:35:14.488020 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:35:14.488020 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:35:14.488020 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:35:14.488020 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:35:14.488020 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:35:14.488020 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d95c0294-3423-429b-8bcf-43e2089fca23 could not be found. Jul 15 15:35:14.488020 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:35:14.488020 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:35:14.488020 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:35:14.488020 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:35:14.488020 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:35:14.488020 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:35:14.488020 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:35:14.488020 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:35:14.488020 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:35:14.492046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:35:14.492046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:35:14.492046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:35:14.492046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:35:14.492046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:35:14.492046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:35:14.492046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:35:14.492046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d95c0294-3423-429b-8bcf-43e2089fca23 could not be found. Jul 15 15:35:14.492046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:35:14.492046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:35:14.492046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:35:14.492046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:35:14.492046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:35:14.492046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:35:14.492046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:35:14.492046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:35:14.492046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d95c0294-3423-429b-8bcf-43e2089fca23 could not be found. Jul 15 15:35:14.492046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:35:14.495950 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-069a7b65-6f26-43a8-acae-6a2e9818aeb0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Returning 404 to user: Instance d95c0294-3423-429b-8bcf-43e2089fca23 could not be found. {{(pid=117999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:35:14.495950 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-069a7b65-6f26-43a8-acae-6a2e9818aeb0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 404 len: 111 microversion: 2.1 time: 0.042188 Jul 15 15:35:14.495950 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 349/705] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:14 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 15 15:35:14.496498 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a1ed8cbf-b193-4288-97c5-381afb8393ce tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '.version_select at 0x7fe3c672ab80>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:14.520910 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a1ed8cbf-b193-4288-97c5-381afb8393ce tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-823981827" status: 202 len: 0 microversion: 2.1 time: 0.033855 Jul 15 15:35:14.523105 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 357/706] 10.222.0.40 () {58 vars in 1217 bytes} [Fri Jul 15 15:35:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-823981827 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:35:15.440830 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-38f405d6-c854-48fe-8e60-ece09fe372da tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Action: 'create', calling method: .version_select at 0x7fe3c67c74c0>, body: {"keypair": {"name": "tempest-keypair-529074848", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJog+AiXa/AbM+FiUGqP9g0apImDnTrFD/8yeI21++SWr5tc6gqOP0Ysja6xZAG30kzOQodrm46UY+J2GaRD81nUFsbXEU+FyjbH87UcvIXP0CMWHuhee54S4N/LXjV4w=="}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:35:15.459608 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-38f405d6-c854-48fe-8e60-ece09fe372da tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Getting quotas for project 5e51044e804442909f18288b9a6430a5. Resources: {'key_pairs'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:35:15.464391 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-38f405d6-c854-48fe-8e60-ece09fe372da tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Getting quotas for user 08050c1635084492a4b054b172884af8 and project 5e51044e804442909f18288b9a6430a5. Resources: {'key_pairs'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:35:15.494914 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-38f405d6-c854-48fe-8e60-ece09fe372da tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057988 Jul 15 15:35:15.495505 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 350/707] 10.222.0.40 () {60 vars in 1158 bytes} [Fri Jul 15 15:35:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:35:16.242275 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-92b5e76d-d267-48fc-a491-156b410bb144 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:16.242936 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-92b5e76d-d267-48fc-a491-156b410bb144 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:16.250978 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-92b5e76d-d267-48fc-a491-156b410bb144 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:16.251420 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-92b5e76d-d267-48fc-a491-156b410bb144 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:16.252226 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-92b5e76d-d267-48fc-a491-156b410bb144 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:16.252627 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-92b5e76d-d267-48fc-a491-156b410bb144 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:16.292329 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-92b5e76d-d267-48fc-a491-156b410bb144 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Going to try to terminate instance {{(pid=117998) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 15:35:16.404601 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-92b5e76d-d267-48fc-a491-156b410bb144 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 204 len: 0 microversion: 2.1 time: 0.167324 Jul 15 15:35:16.405569 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 358/708] 10.222.0.40 () {58 vars in 1238 bytes} [Fri Jul 15 15:35:16 2022] DELETE /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:35:16.416426 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-0715ae1a-9f9a-47f7-b174-bfba89577152 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:16.417440 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-0715ae1a-9f9a-47f7-b174-bfba89577152 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:16.425869 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0715ae1a-9f9a-47f7-b174-bfba89577152 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:16.426438 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0715ae1a-9f9a-47f7-b174-bfba89577152 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:16.427702 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0715ae1a-9f9a-47f7-b174-bfba89577152 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:16.428479 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0715ae1a-9f9a-47f7-b174-bfba89577152 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:16.607263 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-0715ae1a-9f9a-47f7-b174-bfba89577152 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:16.616635 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-0715ae1a-9f9a-47f7-b174-bfba89577152 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1508 microversion: 2.1 time: 0.204998 Jul 15 15:35:16.617320 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 351/709] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:16 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1508 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:35:17.157882 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-558e2cec-ca48-4727-a689-b3098045af5d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-860166747", "imageRef": "b9770891-ef3b-4f53-a989-3a4db420d5c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "929a0876-8ea0-426c-a25d-7094debddc3d"}], "security_groups": [{"name": "tempest-securitygroup--236057909"}], "key_name": "tempest-keypair-529074848", "user_data": "}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:35:17.337999 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.network.neutron [None req-558e2cec-ca48-4727-a689-b3098045af5d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] validate_networks() for [('929a0876-8ea0-426c-a25d-7094debddc3d', None, None, None, None, None)] {{(pid=117998) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:35:17.634945 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-d38208c8-0deb-46b4-816a-03cb2bbfcb9c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:17.636498 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-d38208c8-0deb-46b4-816a-03cb2bbfcb9c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:17.644116 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d38208c8-0deb-46b4-816a-03cb2bbfcb9c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:17.644437 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d38208c8-0deb-46b4-816a-03cb2bbfcb9c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:17.645554 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d38208c8-0deb-46b4-816a-03cb2bbfcb9c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:17.646765 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d38208c8-0deb-46b4-816a-03cb2bbfcb9c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:17.923558 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-d38208c8-0deb-46b4-816a-03cb2bbfcb9c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:17.939474 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-d38208c8-0deb-46b4-816a-03cb2bbfcb9c tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 200 len: 1508 microversion: 2.1 time: 0.308245 Jul 15 15:35:17.941496 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 352/710] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:17 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 1508 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:35:17.961265 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-ae66f87c-8fd6-4af6-a74f-70073e81cadb req-9c9c0891-f948-4f24-8b1a-05c534373f88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3291b90a-688c-40b9-ba4e-ef4a6ac4beb0", "name": "network-vif-deleted", "tag": "a5206037-9d2c-4d13-a70b-abb42f166a9f"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:35:17.983782 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-ae66f87c-8fd6-4af6-a74f-70073e81cadb req-9c9c0891-f948-4f24-8b1a-05c534373f88 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:17.984577 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-ae66f87c-8fd6-4af6-a74f-70073e81cadb req-9c9c0891-f948-4f24-8b1a-05c534373f88 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:18.010459 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-ae66f87c-8fd6-4af6-a74f-70073e81cadb req-9c9c0891-f948-4f24-8b1a-05c534373f88 service nova] Creating event network-vif-deleted:a5206037-9d2c-4d13-a70b-abb42f166a9f for instance 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 on hv-cinder-85001 Jul 15 15:35:18.021196 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-ae66f87c-8fd6-4af6-a74f-70073e81cadb req-9c9c0891-f948-4f24-8b1a-05c534373f88 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076889 Jul 15 15:35:18.023476 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 353/711] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:35:18.158693 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-558e2cec-ca48-4727-a689-b3098045af5d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Flavor limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:35:18.159159 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-558e2cec-ca48-4727-a689-b3098045af5d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Image limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:35:18.159642 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-558e2cec-ca48-4727-a689-b3098045af5d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Flavor pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:35:18.160047 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-558e2cec-ca48-4727-a689-b3098045af5d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Image pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:35:18.160455 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-558e2cec-ca48-4727-a689-b3098045af5d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:35:18.170903 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-558e2cec-ca48-4727-a689-b3098045af5d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:18.171338 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-558e2cec-ca48-4727-a689-b3098045af5d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:18.172163 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-558e2cec-ca48-4727-a689-b3098045af5d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:18.172586 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-558e2cec-ca48-4727-a689-b3098045af5d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:18.200962 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-558e2cec-ca48-4727-a689-b3098045af5d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Getting quotas for project 5e51044e804442909f18288b9a6430a5. Resources: {'ram', 'instances', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:35:18.206158 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-558e2cec-ca48-4727-a689-b3098045af5d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Getting quotas for user 08050c1635084492a4b054b172884af8 and project 5e51044e804442909f18288b9a6430a5. Resources: {'ram', 'instances', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:35:18.228287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-558e2cec-ca48-4727-a689-b3098045af5d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Going to run 1 instances... {{(pid=117998) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:35:18.232959 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-558e2cec-ca48-4727-a689-b3098045af5d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9770891-ef3b-4f53-a989-3a4db420d5c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117998) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:35:18.308833 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-558e2cec-ca48-4727-a689-b3098045af5d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.155770 Jul 15 15:35:18.310046 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 359/712] 10.222.0.40 () {60 vars in 1146 bytes} [Fri Jul 15 15:35:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 1162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 15:35:18.325559 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-6a5063d4-6e12-40a4-bc24-862a741f137e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:18.327183 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-6a5063d4-6e12-40a4-bc24-862a741f137e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:18.416568 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6a5063d4-6e12-40a4-bc24-862a741f137e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:18.428880 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-6a5063d4-6e12-40a4-bc24-862a741f137e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592" status: 200 len: 1236 microversion: 2.1 time: 0.110958 Jul 15 15:35:18.431435 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 354/713] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:18 2022] GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 => generated 1236 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:35:18.957381 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-116bcd64-b0a1-4a6f-bf91-9fdc0f61e18d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:18.958341 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-116bcd64-b0a1-4a6f-bf91-9fdc0f61e18d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:18.966018 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-116bcd64-b0a1-4a6f-bf91-9fdc0f61e18d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:18.966459 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-116bcd64-b0a1-4a6f-bf91-9fdc0f61e18d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:18.967254 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-116bcd64-b0a1-4a6f-bf91-9fdc0f61e18d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:18.967677 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-116bcd64-b0a1-4a6f-bf91-9fdc0f61e18d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:18.984355 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-116bcd64-b0a1-4a6f-bf91-9fdc0f61e18d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] HTTP exception thrown: Instance 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 could not be found. Jul 15 15:35:18.986048 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-116bcd64-b0a1-4a6f-bf91-9fdc0f61e18d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Request method failure captured: Jul 15 15:35:18.986048 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 HTTP/1.1 Jul 15 15:35:18.986048 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:35:18.986048 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:35:18.986048 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:35:18.986048 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 15 15:35:18.986048 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:35:18.986048 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:35:18.986048 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:35:18.986048 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:35:18.986048 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0YcsFZkCZjkBbmSTXB7UwekvD5WNzeaEbNt0rITlIw_1hzYJxVEjCSvTE3Iz-khRfNW59h8CDuHoTt68mQeVPMhdAmhxbIqofx4vXjqK5T_vcExmq4CdFYJ8LNVUNZ_zMmgWfaeigTLlD9bCaozXsDQmwZpOGCKkhLeeXY2KxB1RuxI Jul 15 15:35:18.986048 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:35:18.986048 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:35:18.986048 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:35:18.986048 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:35:18.986048 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:35:18.986048 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:35:18.986048 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: 1e21747a454c4ebebb5d48b5906d5e5c Jul 15 15:35:18.986048 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2035142133 Jul 15 15:35:18.986048 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:35:18.986048 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:35:18.988429 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1e21747a454c4ebebb5d48b5906d5e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1e21747a454c4ebebb5d48b5906d5e5c", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1e21747a454c4ebebb5d48b5906d5e5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1e21747a454c4ebebb5d48b5906d5e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:35:18.988429 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2035142133 Jul 15 15:35:18.988429 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 1e21747a454c4ebebb5d48b5906d5e5c Jul 15 15:35:18.988429 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2035142133 Jul 15 15:35:18.988429 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-ServerRescueNegativeTestJSON-2035142133-project Jul 15 15:35:18.988429 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:35:18.988429 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:35:18.988429 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: c1a1af21d3f94b70a830b14200619f87 Jul 15 15:35:18.988429 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2035142133-project Jul 15 15:35:18.988429 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: > Jul 15 15:35:18.988429 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Instance 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 could not be found. Jul 15 15:35:18.988429 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'id': '3291b90a-688c-40b9-ba4e-ef4a6ac4beb0'} Jul 15 15:35:18.989622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:35:18.989622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:35:18.989622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:35:18.989622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:35:18.989622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:35:18.989622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:35:18.989622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:35:18.989622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:35:18.989622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:35:18.989622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:35:18.989622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 could not be found. Jul 15 15:35:18.989622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:35:18.989622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:35:18.989622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:35:18.989622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:35:18.989622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:35:18.989622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:35:18.989622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:35:18.989622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:35:18.989622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:35:18.991725 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:35:18.991725 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:35:18.991725 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:35:18.991725 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:35:18.991725 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:35:18.991725 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:35:18.991725 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:35:18.991725 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 could not be found. Jul 15 15:35:18.991725 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:35:18.991725 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:35:18.991725 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:35:18.991725 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:35:18.991725 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:35:18.991725 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:35:18.991725 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:35:18.991725 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:35:18.991725 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 could not be found. Jul 15 15:35:18.991725 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:35:18.993763 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-116bcd64-b0a1-4a6f-bf91-9fdc0f61e18d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Returning 404 to user: Instance 3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:35:18.993763 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-116bcd64-b0a1-4a6f-bf91-9fdc0f61e18d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0" status: 404 len: 111 microversion: 2.1 time: 0.034086 Jul 15 15:35:18.993763 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 360/714] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:18 2022] GET /compute/v2.1/servers/3291b90a-688c-40b9-ba4e-ef4a6ac4beb0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:35:19.001419 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-22ad37d0-d5cf-490c-9f1e-2cae4753bfd5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:19.002338 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-22ad37d0-d5cf-490c-9f1e-2cae4753bfd5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:19.015614 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-22ad37d0-d5cf-490c-9f1e-2cae4753bfd5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:19.016955 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-22ad37d0-d5cf-490c-9f1e-2cae4753bfd5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:19.018310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-22ad37d0-d5cf-490c-9f1e-2cae4753bfd5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:19.019074 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-22ad37d0-d5cf-490c-9f1e-2cae4753bfd5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:19.064842 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-22ad37d0-d5cf-490c-9f1e-2cae4753bfd5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Going to try to terminate instance {{(pid=117999) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 15:35:19.174009 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-22ad37d0-d5cf-490c-9f1e-2cae4753bfd5 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "DELETE /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 204 len: 0 microversion: 2.1 time: 0.180012 Jul 15 15:35:19.174855 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 355/715] 10.222.0.40 () {58 vars in 1238 bytes} [Fri Jul 15 15:35:18 2022] DELETE /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:35:19.184105 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-18f13f80-64ed-4b0c-8b26-f16507c81aba tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:19.185148 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-18f13f80-64ed-4b0c-8b26-f16507c81aba tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:19.195017 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-18f13f80-64ed-4b0c-8b26-f16507c81aba tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:19.195476 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-18f13f80-64ed-4b0c-8b26-f16507c81aba tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:19.196242 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-18f13f80-64ed-4b0c-8b26-f16507c81aba tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:19.196667 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-18f13f80-64ed-4b0c-8b26-f16507c81aba tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:19.380279 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-18f13f80-64ed-4b0c-8b26-f16507c81aba tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:19.388618 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-18f13f80-64ed-4b0c-8b26-f16507c81aba tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1522 microversion: 2.1 time: 0.209084 Jul 15 15:35:19.389518 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 361/716] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:19 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:35:19.456896 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-6eef849c-51db-425e-ba4f-70f77b8223d0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:19.458212 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-6eef849c-51db-425e-ba4f-70f77b8223d0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:19.467608 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6eef849c-51db-425e-ba4f-70f77b8223d0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:19.468411 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6eef849c-51db-425e-ba4f-70f77b8223d0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:19.469467 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6eef849c-51db-425e-ba4f-70f77b8223d0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:19.469896 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6eef849c-51db-425e-ba4f-70f77b8223d0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:19.569271 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6eef849c-51db-425e-ba4f-70f77b8223d0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:19.580136 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-6eef849c-51db-425e-ba4f-70f77b8223d0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592" status: 200 len: 1296 microversion: 2.1 time: 0.134554 Jul 15 15:35:19.580903 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 356/717] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:19 2022] GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 => generated 1296 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:35:20.410627 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-99beda96-dd90-49d9-8354-9237a7b6953d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:20.411434 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-99beda96-dd90-49d9-8354-9237a7b6953d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:20.419747 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-99beda96-dd90-49d9-8354-9237a7b6953d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:20.420180 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-99beda96-dd90-49d9-8354-9237a7b6953d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:20.420956 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-99beda96-dd90-49d9-8354-9237a7b6953d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:20.421379 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-99beda96-dd90-49d9-8354-9237a7b6953d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:20.605724 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-77a42761-25f1-4c51-a7c5-ab1fb1b8b392 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:20.606432 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-77a42761-25f1-4c51-a7c5-ab1fb1b8b392 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:20.617385 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-77a42761-25f1-4c51-a7c5-ab1fb1b8b392 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:20.617820 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-77a42761-25f1-4c51-a7c5-ab1fb1b8b392 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:20.618824 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-77a42761-25f1-4c51-a7c5-ab1fb1b8b392 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:20.619256 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-77a42761-25f1-4c51-a7c5-ab1fb1b8b392 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:20.762179 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-77a42761-25f1-4c51-a7c5-ab1fb1b8b392 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:20.766073 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:35:20.773199 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-77a42761-25f1-4c51-a7c5-ab1fb1b8b392 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592" status: 200 len: 1294 microversion: 2.1 time: 0.170995 Jul 15 15:35:20.782148 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 357/718] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:20 2022] GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 => generated 1294 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:35:21.034872 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-99beda96-dd90-49d9-8354-9237a7b6953d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:21.045115 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-99beda96-dd90-49d9-8354-9237a7b6953d tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1522 microversion: 2.1 time: 0.639039 Jul 15 15:35:21.045908 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 362/719] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:20 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1522 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:35:21.295405 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-2ae849dd-2616-421c-89cc-41f7ebb9ff44 req-29d65d22-7084-41ab-b243-da1c043e433b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "021070dd-3943-48b0-a90a-b889e49029ae", "name": "network-vif-unplugged", "status": "completed", "tag": "8eaeb63d-dfdc-41da-99f1-1ca36ce2f20f"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:35:21.312865 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-2ae849dd-2616-421c-89cc-41f7ebb9ff44 req-29d65d22-7084-41ab-b243-da1c043e433b service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:21.313599 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-2ae849dd-2616-421c-89cc-41f7ebb9ff44 req-29d65d22-7084-41ab-b243-da1c043e433b service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:21.337378 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-2ae849dd-2616-421c-89cc-41f7ebb9ff44 req-29d65d22-7084-41ab-b243-da1c043e433b service nova] Creating event network-vif-unplugged:8eaeb63d-dfdc-41da-99f1-1ca36ce2f20f for instance 021070dd-3943-48b0-a90a-b889e49029ae on hv-cinder-85001 Jul 15 15:35:21.343099 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-2ae849dd-2616-421c-89cc-41f7ebb9ff44 req-29d65d22-7084-41ab-b243-da1c043e433b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054388 Jul 15 15:35:21.344048 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 358/720] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:35:21.640565 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-8e8cb0e7-01cc-4802-9196-672cd41dd9ca req-cfbb8cce-5905-4e29-9b74-d2c301b9d90d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "021070dd-3943-48b0-a90a-b889e49029ae", "name": "network-vif-deleted", "tag": "8eaeb63d-dfdc-41da-99f1-1ca36ce2f20f"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:35:21.670034 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-8e8cb0e7-01cc-4802-9196-672cd41dd9ca req-cfbb8cce-5905-4e29-9b74-d2c301b9d90d service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:21.670778 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-8e8cb0e7-01cc-4802-9196-672cd41dd9ca req-cfbb8cce-5905-4e29-9b74-d2c301b9d90d service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:21.687626 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-8e8cb0e7-01cc-4802-9196-672cd41dd9ca req-cfbb8cce-5905-4e29-9b74-d2c301b9d90d service nova] Creating event network-vif-deleted:8eaeb63d-dfdc-41da-99f1-1ca36ce2f20f for instance 021070dd-3943-48b0-a90a-b889e49029ae on hv-cinder-85001 Jul 15 15:35:21.694164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-8e8cb0e7-01cc-4802-9196-672cd41dd9ca req-cfbb8cce-5905-4e29-9b74-d2c301b9d90d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062752 Jul 15 15:35:21.695151 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 363/721] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:35:21.803063 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-7f73483a-2650-48af-be37-d67463f36b4a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:21.804210 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-7f73483a-2650-48af-be37-d67463f36b4a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:21.813871 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7f73483a-2650-48af-be37-d67463f36b4a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:21.814680 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7f73483a-2650-48af-be37-d67463f36b4a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:21.815989 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7f73483a-2650-48af-be37-d67463f36b4a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:21.817136 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-7f73483a-2650-48af-be37-d67463f36b4a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:22.064701 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7c6a97a6-67a8-4a0a-a1dc-48e5a0173650 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:22.065305 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7c6a97a6-67a8-4a0a-a1dc-48e5a0173650 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:22.073784 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7c6a97a6-67a8-4a0a-a1dc-48e5a0173650 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:22.074254 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7c6a97a6-67a8-4a0a-a1dc-48e5a0173650 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:22.075080 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7c6a97a6-67a8-4a0a-a1dc-48e5a0173650 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:22.075514 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7c6a97a6-67a8-4a0a-a1dc-48e5a0173650 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:22.117099 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7c6a97a6-67a8-4a0a-a1dc-48e5a0173650 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:22.117535 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7c6a97a6-67a8-4a0a-a1dc-48e5a0173650 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:22.118269 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.objects.instance [None req-7c6a97a6-67a8-4a0a-a1dc-48e5a0173650 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lazy-loading 'fault' on Instance uuid 021070dd-3943-48b0-a90a-b889e49029ae {{(pid=117998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:35:22.162788 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-7f73483a-2650-48af-be37-d67463f36b4a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:22.178231 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-7f73483a-2650-48af-be37-d67463f36b4a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592" status: 200 len: 1361 microversion: 2.1 time: 0.390301 Jul 15 15:35:22.179641 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 359/722] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:21 2022] GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 => generated 1361 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:35:22.201773 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7c6a97a6-67a8-4a0a-a1dc-48e5a0173650 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a1af21d3f94b70a830b14200619f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e21747a454c4ebebb5d48b5906d5e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:22.211246 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7c6a97a6-67a8-4a0a-a1dc-48e5a0173650 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 200 len: 1312 microversion: 2.1 time: 0.150783 Jul 15 15:35:22.212497 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 364/723] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:22 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 1312 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:35:23.197561 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-23c35863-e709-4149-b52f-11c3aac2bbe0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:23.198361 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-23c35863-e709-4149-b52f-11c3aac2bbe0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:23.205668 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-23c35863-e709-4149-b52f-11c3aac2bbe0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:23.206104 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-23c35863-e709-4149-b52f-11c3aac2bbe0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:23.206926 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-23c35863-e709-4149-b52f-11c3aac2bbe0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:23.207373 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-23c35863-e709-4149-b52f-11c3aac2bbe0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:23.235550 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5242a9a8-1039-4b68-9748-c23a1bebc5b2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:23.236661 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5242a9a8-1039-4b68-9748-c23a1bebc5b2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] [instance: 021070dd-3943-48b0-a90a-b889e49029ae] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:23.246035 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5242a9a8-1039-4b68-9748-c23a1bebc5b2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:23.246474 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5242a9a8-1039-4b68-9748-c23a1bebc5b2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:23.247272 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5242a9a8-1039-4b68-9748-c23a1bebc5b2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:23.248003 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5242a9a8-1039-4b68-9748-c23a1bebc5b2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:23.264861 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-5242a9a8-1039-4b68-9748-c23a1bebc5b2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] HTTP exception thrown: Instance 021070dd-3943-48b0-a90a-b889e49029ae could not be found. Jul 15 15:35:23.266586 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5242a9a8-1039-4b68-9748-c23a1bebc5b2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Request method failure captured: Jul 15 15:35:23.266586 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae HTTP/1.1 Jul 15 15:35:23.266586 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:35:23.266586 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:35:23.266586 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:35:23.266586 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 15 15:35:23.266586 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:35:23.266586 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:35:23.266586 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:35:23.266586 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:35:23.266586 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0YcsFZkCZjkBbmSTXB7UwekvD5WNzeaEbNt0rITlIw_1hzYJxVEjCSvTE3Iz-khRfNW59h8CDuHoTt68mQeVPMhdAmhxbIqofx4vXjqK5T_vcExmq4CdFYJ8LNVUNZ_zMmgWfaeigTLlD9bCaozXsDQmwZpOGCKkhLeeXY2KxB1RuxI Jul 15 15:35:23.266586 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:35:23.266586 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:35:23.266586 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:35:23.266586 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:35:23.266586 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:35:23.266586 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:35:23.266586 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: 1e21747a454c4ebebb5d48b5906d5e5c Jul 15 15:35:23.266586 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2035142133 Jul 15 15:35:23.266586 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:35:23.266586 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:35:23.269283 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1e21747a454c4ebebb5d48b5906d5e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1e21747a454c4ebebb5d48b5906d5e5c", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1e21747a454c4ebebb5d48b5906d5e5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1e21747a454c4ebebb5d48b5906d5e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:35:23.269283 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2035142133 Jul 15 15:35:23.269283 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 1e21747a454c4ebebb5d48b5906d5e5c Jul 15 15:35:23.269283 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2035142133 Jul 15 15:35:23.269283 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-ServerRescueNegativeTestJSON-2035142133-project Jul 15 15:35:23.269283 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:35:23.269283 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:35:23.269283 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: c1a1af21d3f94b70a830b14200619f87 Jul 15 15:35:23.269283 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2035142133-project Jul 15 15:35:23.269283 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: > Jul 15 15:35:23.269283 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Instance 021070dd-3943-48b0-a90a-b889e49029ae could not be found. Jul 15 15:35:23.269283 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'id': '021070dd-3943-48b0-a90a-b889e49029ae'} Jul 15 15:35:23.270572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:35:23.270572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:35:23.270572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:35:23.270572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:35:23.270572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:35:23.270572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:35:23.270572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:35:23.270572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:35:23.270572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:35:23.270572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:35:23.270572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 021070dd-3943-48b0-a90a-b889e49029ae could not be found. Jul 15 15:35:23.270572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:35:23.270572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:35:23.270572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:35:23.270572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:35:23.270572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:35:23.270572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:35:23.270572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:35:23.270572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:35:23.270572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:35:23.272506 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:35:23.272506 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:35:23.272506 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:35:23.272506 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:35:23.272506 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:35:23.272506 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:35:23.272506 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:35:23.272506 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 021070dd-3943-48b0-a90a-b889e49029ae could not be found. Jul 15 15:35:23.272506 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:35:23.272506 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:35:23.272506 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:35:23.272506 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:35:23.272506 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:35:23.272506 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:35:23.272506 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:35:23.272506 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:35:23.272506 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 021070dd-3943-48b0-a90a-b889e49029ae could not be found. Jul 15 15:35:23.272506 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:35:23.273593 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5242a9a8-1039-4b68-9748-c23a1bebc5b2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] Returning 404 to user: Instance 021070dd-3943-48b0-a90a-b889e49029ae could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:35:23.273593 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5242a9a8-1039-4b68-9748-c23a1bebc5b2 tempest-ServerRescueNegativeTestJSON-2035142133 tempest-ServerRescueNegativeTestJSON-2035142133-project] 10.222.0.40 "GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae" status: 404 len: 111 microversion: 2.1 time: 0.041277 Jul 15 15:35:23.273593 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 365/724] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:23 2022] GET /compute/v2.1/servers/021070dd-3943-48b0-a90a-b889e49029ae => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:35:23.468953 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-23c35863-e709-4149-b52f-11c3aac2bbe0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:23.484172 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-23c35863-e709-4149-b52f-11c3aac2bbe0 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592" status: 200 len: 1361 microversion: 2.1 time: 0.288001 Jul 15 15:35:23.494187 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 360/725] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:23 2022] GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 => generated 1361 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:35:23.715766 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-2bd73b43-d259-4fc0-ad25-88fba4593fe0 req-6fa828ab-e4c9-45df-9eb1-21758735b573 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2b93b8a-ca26-4f4a-8f4a-6ff7769be592", "tag": "5ae418d2-cd33-40c1-84b3-f759a3b56bd8"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:35:23.726018 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-2bd73b43-d259-4fc0-ad25-88fba4593fe0 req-6fa828ab-e4c9-45df-9eb1-21758735b573 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:23.726445 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-2bd73b43-d259-4fc0-ad25-88fba4593fe0 req-6fa828ab-e4c9-45df-9eb1-21758735b573 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:23.743442 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-2bd73b43-d259-4fc0-ad25-88fba4593fe0 req-6fa828ab-e4c9-45df-9eb1-21758735b573 service nova] Creating event network-changed:5ae418d2-cd33-40c1-84b3-f759a3b56bd8 for instance d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 on hv-cinder-85001 Jul 15 15:35:23.751064 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-2bd73b43-d259-4fc0-ad25-88fba4593fe0 req-6fa828ab-e4c9-45df-9eb1-21758735b573 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040770 Jul 15 15:35:23.751840 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 366/726] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:35:24.502089 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-cdcabd43-ad98-46e1-a397-41fb90483571 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:24.502911 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-cdcabd43-ad98-46e1-a397-41fb90483571 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:24.512573 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cdcabd43-ad98-46e1-a397-41fb90483571 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:24.515600 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cdcabd43-ad98-46e1-a397-41fb90483571 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:24.515600 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cdcabd43-ad98-46e1-a397-41fb90483571 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:24.515982 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cdcabd43-ad98-46e1-a397-41fb90483571 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:24.688848 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-cdcabd43-ad98-46e1-a397-41fb90483571 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:24.700508 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-cdcabd43-ad98-46e1-a397-41fb90483571 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592" status: 200 len: 1361 microversion: 2.1 time: 0.202489 Jul 15 15:35:24.701589 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 361/727] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:24 2022] GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 => generated 1361 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:35:25.730489 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9ea8670a-d731-407b-877d-cb15038ef106 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:25.731530 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9ea8670a-d731-407b-877d-cb15038ef106 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:25.741915 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9ea8670a-d731-407b-877d-cb15038ef106 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:25.743042 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9ea8670a-d731-407b-877d-cb15038ef106 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:25.744392 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9ea8670a-d731-407b-877d-cb15038ef106 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:25.745218 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9ea8670a-d731-407b-877d-cb15038ef106 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:25.920714 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9ea8670a-d731-407b-877d-cb15038ef106 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:25.924831 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:35:25.931913 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9ea8670a-d731-407b-877d-cb15038ef106 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592" status: 200 len: 1361 microversion: 2.1 time: 0.209991 Jul 15 15:35:25.932527 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 367/728] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:25 2022] GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:35:26.955181 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-b1a4acdd-a4cd-40a5-9c9b-4422202011e4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:26.955990 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-b1a4acdd-a4cd-40a5-9c9b-4422202011e4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:26.968158 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b1a4acdd-a4cd-40a5-9c9b-4422202011e4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:26.968607 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b1a4acdd-a4cd-40a5-9c9b-4422202011e4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:26.969639 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b1a4acdd-a4cd-40a5-9c9b-4422202011e4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:26.970330 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b1a4acdd-a4cd-40a5-9c9b-4422202011e4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:27.166231 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b1a4acdd-a4cd-40a5-9c9b-4422202011e4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:27.174916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-b1a4acdd-a4cd-40a5-9c9b-4422202011e4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592" status: 200 len: 1361 microversion: 2.1 time: 0.223943 Jul 15 15:35:27.185549 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 362/729] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:26 2022] GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 => generated 1361 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:35:28.193044 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-589f98a1-1989-4cc8-8824-8a2571111753 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:28.193833 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-589f98a1-1989-4cc8-8824-8a2571111753 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:28.197615 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:35:28.209193 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-589f98a1-1989-4cc8-8824-8a2571111753 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:28.209616 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-589f98a1-1989-4cc8-8824-8a2571111753 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:28.210384 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-589f98a1-1989-4cc8-8824-8a2571111753 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:28.210844 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-589f98a1-1989-4cc8-8824-8a2571111753 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:28.227198 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=6 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:35:28.394188 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-589f98a1-1989-4cc8-8824-8a2571111753 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:28.407338 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-589f98a1-1989-4cc8-8824-8a2571111753 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592" status: 200 len: 1361 microversion: 2.1 time: 0.217851 Jul 15 15:35:28.408364 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 368/730] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:28 2022] GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 => generated 1361 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:35:29.374679 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-cec889b7-7f22-4ac6-add9-34834af60d51 req-44b695ab-90e8-4d1a-8e4c-d52abb7e59c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b93b8a-ca26-4f4a-8f4a-6ff7769be592", "name": "network-vif-plugged", "status": "completed", "tag": "5ae418d2-cd33-40c1-84b3-f759a3b56bd8"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:35:29.381539 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=6 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:35:29.390325 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-cec889b7-7f22-4ac6-add9-34834af60d51 req-44b695ab-90e8-4d1a-8e4c-d52abb7e59c6 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:29.390794 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-cec889b7-7f22-4ac6-add9-34834af60d51 req-44b695ab-90e8-4d1a-8e4c-d52abb7e59c6 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:29.404591 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-cec889b7-7f22-4ac6-add9-34834af60d51 req-44b695ab-90e8-4d1a-8e4c-d52abb7e59c6 service nova] Creating event network-vif-plugged:5ae418d2-cd33-40c1-84b3-f759a3b56bd8 for instance d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 on hv-cinder-85001 Jul 15 15:35:29.410738 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-cec889b7-7f22-4ac6-add9-34834af60d51 req-44b695ab-90e8-4d1a-8e4c-d52abb7e59c6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040529 Jul 15 15:35:29.412206 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 363/731] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:35:29.438161 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7d9fddf8-fd4e-49b9-a857-54d5e2f55122 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:29.441190 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7d9fddf8-fd4e-49b9-a857-54d5e2f55122 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:29.450255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7d9fddf8-fd4e-49b9-a857-54d5e2f55122 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:29.451136 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7d9fddf8-fd4e-49b9-a857-54d5e2f55122 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:29.452065 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7d9fddf8-fd4e-49b9-a857-54d5e2f55122 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:29.452730 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7d9fddf8-fd4e-49b9-a857-54d5e2f55122 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:29.688391 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7d9fddf8-fd4e-49b9-a857-54d5e2f55122 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:29.697535 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7d9fddf8-fd4e-49b9-a857-54d5e2f55122 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592" status: 200 len: 1361 microversion: 2.1 time: 0.273644 Jul 15 15:35:29.698182 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 369/732] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:29 2022] GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 => generated 1361 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:35:30.720410 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-ef20fd6e-d21f-45bc-8d86-a64e5e8e1644 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:30.721204 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-ef20fd6e-d21f-45bc-8d86-a64e5e8e1644 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:30.728529 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ef20fd6e-d21f-45bc-8d86-a64e5e8e1644 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:30.728966 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ef20fd6e-d21f-45bc-8d86-a64e5e8e1644 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:30.729755 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ef20fd6e-d21f-45bc-8d86-a64e5e8e1644 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:30.730180 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ef20fd6e-d21f-45bc-8d86-a64e5e8e1644 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:30.886079 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-ef20fd6e-d21f-45bc-8d86-a64e5e8e1644 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:30.894944 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-ef20fd6e-d21f-45bc-8d86-a64e5e8e1644 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592" status: 200 len: 1361 microversion: 2.1 time: 0.179639 Jul 15 15:35:30.895588 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 364/733] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:30 2022] GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:35:31.916371 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-37cd3301-e899-45b7-bc4c-50dc688c8f3b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:31.917070 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-37cd3301-e899-45b7-bc4c-50dc688c8f3b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:31.924516 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-37cd3301-e899-45b7-bc4c-50dc688c8f3b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:31.924936 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-37cd3301-e899-45b7-bc4c-50dc688c8f3b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:31.925702 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-37cd3301-e899-45b7-bc4c-50dc688c8f3b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:31.926124 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-37cd3301-e899-45b7-bc4c-50dc688c8f3b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:32.087001 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-37cd3301-e899-45b7-bc4c-50dc688c8f3b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:32.099058 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-37cd3301-e899-45b7-bc4c-50dc688c8f3b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592" status: 200 len: 1547 microversion: 2.1 time: 0.188656 Jul 15 15:35:32.099954 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 370/734] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:31 2022] GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 => generated 1547 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:35:32.120220 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-8bd5449f-89a9-46a7-bd63-bf86b6db40ae tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:32.121047 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-8bd5449f-89a9-46a7-bd63-bf86b6db40ae tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:32.131301 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8bd5449f-89a9-46a7-bd63-bf86b6db40ae tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:32.132662 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8bd5449f-89a9-46a7-bd63-bf86b6db40ae tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:32.132662 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8bd5449f-89a9-46a7-bd63-bf86b6db40ae tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:32.132984 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8bd5449f-89a9-46a7-bd63-bf86b6db40ae tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:32.239172 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-8bd5449f-89a9-46a7-bd63-bf86b6db40ae tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125614 Jul 15 15:35:32.240123 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 365/735] 10.222.0.40 () {58 vars in 1274 bytes} [Fri Jul 15 15:35:32 2022] GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:35:33.563217 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-f7437b3d-c2bc-4d8a-84ae-d4fb149bce75 req-dbed396c-563f-4790-94fb-9bdacbb32ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2b93b8a-ca26-4f4a-8f4a-6ff7769be592", "tag": "5ae418d2-cd33-40c1-84b3-f759a3b56bd8"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:35:33.579180 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-f7437b3d-c2bc-4d8a-84ae-d4fb149bce75 req-dbed396c-563f-4790-94fb-9bdacbb32ce8 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:33.580360 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-f7437b3d-c2bc-4d8a-84ae-d4fb149bce75 req-dbed396c-563f-4790-94fb-9bdacbb32ce8 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:33.599113 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-f7437b3d-c2bc-4d8a-84ae-d4fb149bce75 req-dbed396c-563f-4790-94fb-9bdacbb32ce8 service nova] Creating event network-changed:5ae418d2-cd33-40c1-84b3-f759a3b56bd8 for instance d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 on hv-cinder-85001 Jul 15 15:35:33.608736 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-f7437b3d-c2bc-4d8a-84ae-d4fb149bce75 req-dbed396c-563f-4790-94fb-9bdacbb32ce8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051558 Jul 15 15:35:33.610974 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 371/736] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:35:58.076800 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:35:58.077548 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=38 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:35:58.081836 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3ec7e95b-0d3a-4e19-9a25-392f52111eaf tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-74427247", "imageRef": "b9770891-ef3b-4f53-a989-3a4db420d5c5", "flavorRef": "452"}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:35:58.137339 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.network.neutron [None req-3ec7e95b-0d3a-4e19-9a25-392f52111eaf tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] validate_networks() for None {{(pid=117999) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:35:58.440520 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-3ec7e95b-0d3a-4e19-9a25-392f52111eaf tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Flavor limits 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:35:58.441172 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-3ec7e95b-0d3a-4e19-9a25-392f52111eaf tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Image limits 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:35:58.441925 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-3ec7e95b-0d3a-4e19-9a25-392f52111eaf tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Flavor pref 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:35:58.442554 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-3ec7e95b-0d3a-4e19-9a25-392f52111eaf tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Image pref 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:35:58.443208 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-3ec7e95b-0d3a-4e19-9a25-392f52111eaf tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:35:58.454570 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3ec7e95b-0d3a-4e19-9a25-392f52111eaf tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:58.454986 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3ec7e95b-0d3a-4e19-9a25-392f52111eaf tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:58.455774 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3ec7e95b-0d3a-4e19-9a25-392f52111eaf tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:58.456203 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3ec7e95b-0d3a-4e19-9a25-392f52111eaf tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:58.475452 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-3ec7e95b-0d3a-4e19-9a25-392f52111eaf tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Getting quotas for project af8ddde0deb24e7a9222ec5da477018e. Resources: {'ram', 'instances', 'cores'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:35:58.482129 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-3ec7e95b-0d3a-4e19-9a25-392f52111eaf tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Getting quotas for user d590d4ec416b4e59b1133f3abf86fc7e and project af8ddde0deb24e7a9222ec5da477018e. Resources: {'ram', 'instances', 'cores'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:35:58.493888 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-3ec7e95b-0d3a-4e19-9a25-392f52111eaf tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Going to run 1 instances... {{(pid=117999) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:35:58.496224 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-3ec7e95b-0d3a-4e19-9a25-392f52111eaf tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] [instance: 5346107a-1021-45e4-8e05-8a57a7757722] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9770891-ef3b-4f53-a989-3a4db420d5c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117999) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:35:58.544138 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-3ec7e95b-0d3a-4e19-9a25-392f52111eaf tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.468767 Jul 15 15:35:58.544652 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 366/737] 10.222.0.40 () {60 vars in 1146 bytes} [Fri Jul 15 15:35:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 15:35:58.555464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0d3f0ab0-df32-4aba-b91e-0cac525a8f42 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:58.556146 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-0d3f0ab0-df32-4aba-b91e-0cac525a8f42 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] [instance: 5346107a-1021-45e4-8e05-8a57a7757722] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:58.559881 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:35:58.560921 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=20 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:35:58.615997 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0d3f0ab0-df32-4aba-b91e-0cac525a8f42 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd590d4ec416b4e59b1133f3abf86fc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8ddde0deb24e7a9222ec5da477018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:58.623223 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-0d3f0ab0-df32-4aba-b91e-0cac525a8f42 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] 10.222.0.40 "GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722" status: 200 len: 1213 microversion: 2.1 time: 0.072118 Jul 15 15:35:58.623789 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 372/738] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:58 2022] GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722 => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:35:59.642445 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-4db58d63-815f-46ff-bb8b-d560f3ee4dbc tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:35:59.643885 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-4db58d63-815f-46ff-bb8b-d560f3ee4dbc tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] [instance: 5346107a-1021-45e4-8e05-8a57a7757722] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:35:59.651237 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4db58d63-815f-46ff-bb8b-d560f3ee4dbc tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:59.652086 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4db58d63-815f-46ff-bb8b-d560f3ee4dbc tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:59.653212 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4db58d63-815f-46ff-bb8b-d560f3ee4dbc tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:35:59.653641 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4db58d63-815f-46ff-bb8b-d560f3ee4dbc tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:35:59.734327 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-4db58d63-815f-46ff-bb8b-d560f3ee4dbc tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd590d4ec416b4e59b1133f3abf86fc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8ddde0deb24e7a9222ec5da477018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:35:59.742608 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-4db58d63-815f-46ff-bb8b-d560f3ee4dbc tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] 10.222.0.40 "GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722" status: 200 len: 1283 microversion: 2.1 time: 0.105786 Jul 15 15:35:59.743132 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 367/739] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:35:59 2022] GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722 => generated 1283 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:36:00.762466 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-08ce09d7-c4ce-42cc-ba84-9cb899b71338 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:00.763315 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-08ce09d7-c4ce-42cc-ba84-9cb899b71338 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] [instance: 5346107a-1021-45e4-8e05-8a57a7757722] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:00.772269 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-08ce09d7-c4ce-42cc-ba84-9cb899b71338 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:00.772683 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-08ce09d7-c4ce-42cc-ba84-9cb899b71338 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:00.773488 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-08ce09d7-c4ce-42cc-ba84-9cb899b71338 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:00.773917 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-08ce09d7-c4ce-42cc-ba84-9cb899b71338 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:00.977522 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-08ce09d7-c4ce-42cc-ba84-9cb899b71338 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd590d4ec416b4e59b1133f3abf86fc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8ddde0deb24e7a9222ec5da477018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:00.992961 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-08ce09d7-c4ce-42cc-ba84-9cb899b71338 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] 10.222.0.40 "GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722" status: 200 len: 1313 microversion: 2.1 time: 0.235730 Jul 15 15:36:00.994056 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 373/740] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:36:00 2022] GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:36:01.275430 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-0e022e61-5789-4980-9c25-e5faf822cd70 req-34dd2575-9736-4ec8-8e1e-08842ee923b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5346107a-1021-45e4-8e05-8a57a7757722", "tag": "d4bc171d-fc87-4b23-b393-e83c800f458f"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:36:01.284833 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-0e022e61-5789-4980-9c25-e5faf822cd70 req-34dd2575-9736-4ec8-8e1e-08842ee923b1 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:01.285536 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-0e022e61-5789-4980-9c25-e5faf822cd70 req-34dd2575-9736-4ec8-8e1e-08842ee923b1 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:01.304573 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-0e022e61-5789-4980-9c25-e5faf822cd70 req-34dd2575-9736-4ec8-8e1e-08842ee923b1 service nova] Creating event network-changed:d4bc171d-fc87-4b23-b393-e83c800f458f for instance 5346107a-1021-45e4-8e05-8a57a7757722 on hv-cinder-85001 Jul 15 15:36:01.309921 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-0e022e61-5789-4980-9c25-e5faf822cd70 req-34dd2575-9736-4ec8-8e1e-08842ee923b1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038063 Jul 15 15:36:01.310869 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 368/741] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:36:02.010567 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-267a4959-9104-45b6-8e0f-43b730fa5e86 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:02.011160 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-267a4959-9104-45b6-8e0f-43b730fa5e86 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] [instance: 5346107a-1021-45e4-8e05-8a57a7757722] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:02.018315 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-267a4959-9104-45b6-8e0f-43b730fa5e86 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:02.018891 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-267a4959-9104-45b6-8e0f-43b730fa5e86 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:02.019659 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-267a4959-9104-45b6-8e0f-43b730fa5e86 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:02.020095 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-267a4959-9104-45b6-8e0f-43b730fa5e86 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:02.164201 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-267a4959-9104-45b6-8e0f-43b730fa5e86 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd590d4ec416b4e59b1133f3abf86fc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8ddde0deb24e7a9222ec5da477018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:02.173341 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-267a4959-9104-45b6-8e0f-43b730fa5e86 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] 10.222.0.40 "GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722" status: 200 len: 1313 microversion: 2.1 time: 0.166744 Jul 15 15:36:02.173912 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 374/742] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:36:02 2022] GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:36:03.191801 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-42dfc2b9-8782-46ee-827e-cf4f31bb4ae0 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:03.192496 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-42dfc2b9-8782-46ee-827e-cf4f31bb4ae0 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] [instance: 5346107a-1021-45e4-8e05-8a57a7757722] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:03.199280 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-42dfc2b9-8782-46ee-827e-cf4f31bb4ae0 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:03.199729 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-42dfc2b9-8782-46ee-827e-cf4f31bb4ae0 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:03.200500 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-42dfc2b9-8782-46ee-827e-cf4f31bb4ae0 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:03.200931 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-42dfc2b9-8782-46ee-827e-cf4f31bb4ae0 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:03.356928 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-42dfc2b9-8782-46ee-827e-cf4f31bb4ae0 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd590d4ec416b4e59b1133f3abf86fc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8ddde0deb24e7a9222ec5da477018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:03.365841 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-42dfc2b9-8782-46ee-827e-cf4f31bb4ae0 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] 10.222.0.40 "GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722" status: 200 len: 1313 microversion: 2.1 time: 0.178814 Jul 15 15:36:03.366627 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 369/743] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:36:03 2022] GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:36:04.385512 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4c19dd2e-a822-4ad3-b7bb-c2e60667dafb tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:04.386566 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-4c19dd2e-a822-4ad3-b7bb-c2e60667dafb tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] [instance: 5346107a-1021-45e4-8e05-8a57a7757722] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:04.394066 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4c19dd2e-a822-4ad3-b7bb-c2e60667dafb tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:04.394549 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4c19dd2e-a822-4ad3-b7bb-c2e60667dafb tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:04.395296 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4c19dd2e-a822-4ad3-b7bb-c2e60667dafb tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:04.395754 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4c19dd2e-a822-4ad3-b7bb-c2e60667dafb tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:04.529630 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-4c19dd2e-a822-4ad3-b7bb-c2e60667dafb tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd590d4ec416b4e59b1133f3abf86fc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8ddde0deb24e7a9222ec5da477018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:04.538848 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4c19dd2e-a822-4ad3-b7bb-c2e60667dafb tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] 10.222.0.40 "GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722" status: 200 len: 1313 microversion: 2.1 time: 0.157160 Jul 15 15:36:04.539382 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 375/744] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:36:04 2022] GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:36:05.556582 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-6ee87e92-c564-4581-9082-ed1e81aaadeb tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:05.557176 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-6ee87e92-c564-4581-9082-ed1e81aaadeb tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] [instance: 5346107a-1021-45e4-8e05-8a57a7757722] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:05.564854 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6ee87e92-c564-4581-9082-ed1e81aaadeb tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:05.565436 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6ee87e92-c564-4581-9082-ed1e81aaadeb tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:05.566331 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6ee87e92-c564-4581-9082-ed1e81aaadeb tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:05.566957 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6ee87e92-c564-4581-9082-ed1e81aaadeb tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:05.700265 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6ee87e92-c564-4581-9082-ed1e81aaadeb tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd590d4ec416b4e59b1133f3abf86fc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8ddde0deb24e7a9222ec5da477018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:05.708783 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-6ee87e92-c564-4581-9082-ed1e81aaadeb tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] 10.222.0.40 "GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722" status: 200 len: 1313 microversion: 2.1 time: 0.156067 Jul 15 15:36:05.709359 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 370/745] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:36:05 2022] GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:36:06.726724 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-506ee6ab-608b-47c3-bc6a-bf9f320b97aa tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:06.727327 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-506ee6ab-608b-47c3-bc6a-bf9f320b97aa tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] [instance: 5346107a-1021-45e4-8e05-8a57a7757722] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:06.734554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-506ee6ab-608b-47c3-bc6a-bf9f320b97aa tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:06.735015 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-506ee6ab-608b-47c3-bc6a-bf9f320b97aa tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:06.735777 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-506ee6ab-608b-47c3-bc6a-bf9f320b97aa tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:06.736202 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-506ee6ab-608b-47c3-bc6a-bf9f320b97aa tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:06.872674 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-506ee6ab-608b-47c3-bc6a-bf9f320b97aa tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd590d4ec416b4e59b1133f3abf86fc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8ddde0deb24e7a9222ec5da477018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:06.880577 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-506ee6ab-608b-47c3-bc6a-bf9f320b97aa tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] 10.222.0.40 "GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722" status: 200 len: 1313 microversion: 2.1 time: 0.158215 Jul 15 15:36:06.881075 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 376/746] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:36:06 2022] GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:36:07.596314 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-d1ef6db1-17e3-4b18-930a-eeeefb1580ba req-c9a6baec-de21-4347-8b9c-b62397c30776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5346107a-1021-45e4-8e05-8a57a7757722", "name": "network-vif-plugged", "status": "completed", "tag": "d4bc171d-fc87-4b23-b393-e83c800f458f"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:36:07.605064 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-d1ef6db1-17e3-4b18-930a-eeeefb1580ba req-c9a6baec-de21-4347-8b9c-b62397c30776 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:07.605545 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-d1ef6db1-17e3-4b18-930a-eeeefb1580ba req-c9a6baec-de21-4347-8b9c-b62397c30776 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:07.619555 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-d1ef6db1-17e3-4b18-930a-eeeefb1580ba req-c9a6baec-de21-4347-8b9c-b62397c30776 service nova] Creating event network-vif-plugged:d4bc171d-fc87-4b23-b393-e83c800f458f for instance 5346107a-1021-45e4-8e05-8a57a7757722 on hv-cinder-85001 Jul 15 15:36:07.624803 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-d1ef6db1-17e3-4b18-930a-eeeefb1580ba req-c9a6baec-de21-4347-8b9c-b62397c30776 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032336 Jul 15 15:36:07.625854 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 371/747] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:36:07.901975 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-fece1b84-b467-4e3e-8284-c7a5e3dce738 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:07.902742 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-fece1b84-b467-4e3e-8284-c7a5e3dce738 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] [instance: 5346107a-1021-45e4-8e05-8a57a7757722] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:07.909541 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fece1b84-b467-4e3e-8284-c7a5e3dce738 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:07.910281 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fece1b84-b467-4e3e-8284-c7a5e3dce738 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:07.911077 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fece1b84-b467-4e3e-8284-c7a5e3dce738 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:07.911494 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fece1b84-b467-4e3e-8284-c7a5e3dce738 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:08.052727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-fece1b84-b467-4e3e-8284-c7a5e3dce738 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd590d4ec416b4e59b1133f3abf86fc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8ddde0deb24e7a9222ec5da477018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:08.060263 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-fece1b84-b467-4e3e-8284-c7a5e3dce738 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] 10.222.0.40 "GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722" status: 200 len: 1313 microversion: 2.1 time: 0.165474 Jul 15 15:36:08.060819 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 377/748] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:36:07 2022] GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:36:09.078788 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-effdcabe-75fd-419a-9c29-f4be75ef0b0c tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:09.079790 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-effdcabe-75fd-419a-9c29-f4be75ef0b0c tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] [instance: 5346107a-1021-45e4-8e05-8a57a7757722] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:09.081652 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=2 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:36:09.082377 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=6 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:36:09.089170 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-effdcabe-75fd-419a-9c29-f4be75ef0b0c tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:09.089604 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-effdcabe-75fd-419a-9c29-f4be75ef0b0c tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:09.090366 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-effdcabe-75fd-419a-9c29-f4be75ef0b0c tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:09.090820 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-effdcabe-75fd-419a-9c29-f4be75ef0b0c tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:09.226145 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-effdcabe-75fd-419a-9c29-f4be75ef0b0c tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd590d4ec416b4e59b1133f3abf86fc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8ddde0deb24e7a9222ec5da477018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:09.234075 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-effdcabe-75fd-419a-9c29-f4be75ef0b0c tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] 10.222.0.40 "GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722" status: 200 len: 1313 microversion: 2.1 time: 0.159619 Jul 15 15:36:09.234811 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 372/749] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:36:09 2022] GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:36:10.251259 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8fa4626d-9268-4930-b731-a368730378cc tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:10.251863 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8fa4626d-9268-4930-b731-a368730378cc tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] [instance: 5346107a-1021-45e4-8e05-8a57a7757722] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:10.253807 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:36:10.259564 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8fa4626d-9268-4930-b731-a368730378cc tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:10.260016 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8fa4626d-9268-4930-b731-a368730378cc tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:10.260782 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8fa4626d-9268-4930-b731-a368730378cc tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:10.261189 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8fa4626d-9268-4930-b731-a368730378cc tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:10.401090 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8fa4626d-9268-4930-b731-a368730378cc tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd590d4ec416b4e59b1133f3abf86fc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8ddde0deb24e7a9222ec5da477018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:10.409263 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8fa4626d-9268-4930-b731-a368730378cc tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] 10.222.0.40 "GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722" status: 200 len: 1463 microversion: 2.1 time: 0.161901 Jul 15 15:36:10.409834 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 378/750] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:36:10 2022] GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722 => generated 1463 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:36:10.451661 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-848456ab-d5d7-40f9-bb5c-64ca183e180a tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:10.452183 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-848456ab-d5d7-40f9-bb5c-64ca183e180a tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] [instance: 5346107a-1021-45e4-8e05-8a57a7757722] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:10.459207 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-848456ab-d5d7-40f9-bb5c-64ca183e180a tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:10.459642 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-848456ab-d5d7-40f9-bb5c-64ca183e180a tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:10.460391 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-848456ab-d5d7-40f9-bb5c-64ca183e180a tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:10.460807 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-848456ab-d5d7-40f9-bb5c-64ca183e180a tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:10.485704 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-848456ab-d5d7-40f9-bb5c-64ca183e180a tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] [instance: 5346107a-1021-45e4-8e05-8a57a7757722] Going to try to terminate instance {{(pid=117999) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 15:36:10.562186 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-848456ab-d5d7-40f9-bb5c-64ca183e180a tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722" status: 204 len: 0 microversion: 2.1 time: 0.114060 Jul 15 15:36:10.562723 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 373/751] 10.222.0.40 () {58 vars in 1238 bytes} [Fri Jul 15 15:36:10 2022] DELETE /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:36:10.571243 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7566e6c9-9207-4e42-959a-cff9a6b5ce2d tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:10.572007 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7566e6c9-9207-4e42-959a-cff9a6b5ce2d tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] [instance: 5346107a-1021-45e4-8e05-8a57a7757722] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:10.578206 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7566e6c9-9207-4e42-959a-cff9a6b5ce2d tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:10.578691 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7566e6c9-9207-4e42-959a-cff9a6b5ce2d tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:10.579762 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7566e6c9-9207-4e42-959a-cff9a6b5ce2d tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:10.580294 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7566e6c9-9207-4e42-959a-cff9a6b5ce2d tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:10.721473 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7566e6c9-9207-4e42-959a-cff9a6b5ce2d tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd590d4ec416b4e59b1133f3abf86fc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8ddde0deb24e7a9222ec5da477018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:10.729309 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7566e6c9-9207-4e42-959a-cff9a6b5ce2d tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] 10.222.0.40 "GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722" status: 200 len: 1469 microversion: 2.1 time: 0.162135 Jul 15 15:36:10.729871 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 379/752] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:36:10 2022] GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722 => generated 1469 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:36:11.802556 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-5bda3b9e-019e-4efd-b36d-3a66737d7866 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:11.803247 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-5bda3b9e-019e-4efd-b36d-3a66737d7866 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] [instance: 5346107a-1021-45e4-8e05-8a57a7757722] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:11.812833 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5bda3b9e-019e-4efd-b36d-3a66737d7866 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:11.813324 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5bda3b9e-019e-4efd-b36d-3a66737d7866 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:11.814112 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5bda3b9e-019e-4efd-b36d-3a66737d7866 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:11.814587 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5bda3b9e-019e-4efd-b36d-3a66737d7866 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:11.956736 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-5bda3b9e-019e-4efd-b36d-3a66737d7866 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd590d4ec416b4e59b1133f3abf86fc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8ddde0deb24e7a9222ec5da477018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:11.964626 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-5bda3b9e-019e-4efd-b36d-3a66737d7866 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] 10.222.0.40 "GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722" status: 200 len: 1469 microversion: 2.1 time: 0.166902 Jul 15 15:36:11.965197 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 374/753] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:36:11 2022] GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722 => generated 1469 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:36:12.914876 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-79f7effb-d33d-46e9-9591-17d2fb296fcb req-449d3005-dd4b-4666-a34d-ee5f6952e8ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5346107a-1021-45e4-8e05-8a57a7757722", "name": "network-vif-deleted", "tag": "d4bc171d-fc87-4b23-b393-e83c800f458f"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:36:12.926275 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-79f7effb-d33d-46e9-9591-17d2fb296fcb req-449d3005-dd4b-4666-a34d-ee5f6952e8ab service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:12.927232 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-79f7effb-d33d-46e9-9591-17d2fb296fcb req-449d3005-dd4b-4666-a34d-ee5f6952e8ab service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:12.941720 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-79f7effb-d33d-46e9-9591-17d2fb296fcb req-449d3005-dd4b-4666-a34d-ee5f6952e8ab service nova] Creating event network-vif-deleted:d4bc171d-fc87-4b23-b393-e83c800f458f for instance 5346107a-1021-45e4-8e05-8a57a7757722 on hv-cinder-85001 Jul 15 15:36:12.947492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-79f7effb-d33d-46e9-9591-17d2fb296fcb req-449d3005-dd4b-4666-a34d-ee5f6952e8ab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036962 Jul 15 15:36:12.948406 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 380/754] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:36:12.981822 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-bcd8a6c6-15bf-45bc-9eea-fc8065a0a2a1 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:12.982498 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-bcd8a6c6-15bf-45bc-9eea-fc8065a0a2a1 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] [instance: 5346107a-1021-45e4-8e05-8a57a7757722] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:12.990254 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bcd8a6c6-15bf-45bc-9eea-fc8065a0a2a1 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:12.990723 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bcd8a6c6-15bf-45bc-9eea-fc8065a0a2a1 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:12.991788 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bcd8a6c6-15bf-45bc-9eea-fc8065a0a2a1 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:12.992279 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bcd8a6c6-15bf-45bc-9eea-fc8065a0a2a1 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:13.027445 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bcd8a6c6-15bf-45bc-9eea-fc8065a0a2a1 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:13.027891 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bcd8a6c6-15bf-45bc-9eea-fc8065a0a2a1 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:13.028342 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.objects.instance [None req-bcd8a6c6-15bf-45bc-9eea-fc8065a0a2a1 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lazy-loading 'fault' on Instance uuid 5346107a-1021-45e4-8e05-8a57a7757722 {{(pid=117999) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:36:13.292623 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-bcd8a6c6-15bf-45bc-9eea-fc8065a0a2a1 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd590d4ec416b4e59b1133f3abf86fc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8ddde0deb24e7a9222ec5da477018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:13.301124 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-bcd8a6c6-15bf-45bc-9eea-fc8065a0a2a1 tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] 10.222.0.40 "GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722" status: 200 len: 1303 microversion: 2.1 time: 0.323735 Jul 15 15:36:13.301703 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 375/755] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:36:12 2022] GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722 => generated 1303 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:36:14.321008 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3b769920-0623-43ff-963a-bbfd849bf94b tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:14.321733 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3b769920-0623-43ff-963a-bbfd849bf94b tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] [instance: 5346107a-1021-45e4-8e05-8a57a7757722] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:14.328397 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3b769920-0623-43ff-963a-bbfd849bf94b tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:14.328850 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3b769920-0623-43ff-963a-bbfd849bf94b tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:14.329669 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3b769920-0623-43ff-963a-bbfd849bf94b tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:14.330098 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3b769920-0623-43ff-963a-bbfd849bf94b tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:14.344458 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-3b769920-0623-43ff-963a-bbfd849bf94b tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] HTTP exception thrown: Instance 5346107a-1021-45e4-8e05-8a57a7757722 could not be found. Jul 15 15:36:14.346137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3b769920-0623-43ff-963a-bbfd849bf94b tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Request method failure captured: Jul 15 15:36:14.346137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722 HTTP/1.1 Jul 15 15:36:14.346137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:36:14.346137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:36:14.346137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:36:14.346137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 15 15:36:14.346137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:36:14.346137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:36:14.346137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:36:14.346137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:36:14.346137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0Ylco1SI9HiSDIu9YzqXagVAdEx2oeFNlJ0YiPu6oX1MH-KgS5IgwW13960BNUJKVHHtJv3RRZtC4WnQqgFAKblR63xUakgugbMcsAjYMeS_mckYUjA0A0mm05THHwPgSyjjZxJeR3sDXivKyz_IlsbNA-lnObmONwNmKVh0w0jNJEU Jul 15 15:36:14.346137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:36:14.346137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:36:14.346137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:36:14.346137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:36:14.346137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:36:14.346137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:36:14.346137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: af8ddde0deb24e7a9222ec5da477018e Jul 15 15:36:14.346137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-VolumesNegativeTest-1427964725 Jul 15 15:36:14.346137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:36:14.346137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:36:14.347863 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af8ddde0deb24e7a9222ec5da477018e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af8ddde0deb24e7a9222ec5da477018e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af8ddde0deb24e7a9222ec5da477018e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af8ddde0deb24e7a9222ec5da477018e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:36:14.347863 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-VolumesNegativeTest-1427964725 Jul 15 15:36:14.347863 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: af8ddde0deb24e7a9222ec5da477018e Jul 15 15:36:14.347863 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-VolumesNegativeTest-1427964725 Jul 15 15:36:14.347863 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-VolumesNegativeTest-1427964725-project Jul 15 15:36:14.347863 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:36:14.347863 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:36:14.347863 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: d590d4ec416b4e59b1133f3abf86fc7e Jul 15 15:36:14.347863 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-VolumesNegativeTest-1427964725-project Jul 15 15:36:14.347863 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: > Jul 15 15:36:14.347863 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Instance 5346107a-1021-45e4-8e05-8a57a7757722 could not be found. Jul 15 15:36:14.347863 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'id': '5346107a-1021-45e4-8e05-8a57a7757722'} Jul 15 15:36:14.348645 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:36:14.348645 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:36:14.348645 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:36:14.348645 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:36:14.348645 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:36:14.348645 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:36:14.348645 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:36:14.348645 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:36:14.348645 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:36:14.348645 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:36:14.348645 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5346107a-1021-45e4-8e05-8a57a7757722 could not be found. Jul 15 15:36:14.348645 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:36:14.348645 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:36:14.348645 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:36:14.348645 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:36:14.348645 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:36:14.348645 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:36:14.348645 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:36:14.348645 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:36:14.348645 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:36:14.350136 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:36:14.350136 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:36:14.350136 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:36:14.350136 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:36:14.350136 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:36:14.350136 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:36:14.350136 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:36:14.350136 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5346107a-1021-45e4-8e05-8a57a7757722 could not be found. Jul 15 15:36:14.350136 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:36:14.350136 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:36:14.350136 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:36:14.350136 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:36:14.350136 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:36:14.350136 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:36:14.350136 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:36:14.350136 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:36:14.350136 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5346107a-1021-45e4-8e05-8a57a7757722 could not be found. Jul 15 15:36:14.350136 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:36:14.351328 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3b769920-0623-43ff-963a-bbfd849bf94b tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] Returning 404 to user: Instance 5346107a-1021-45e4-8e05-8a57a7757722 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:36:14.351328 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3b769920-0623-43ff-963a-bbfd849bf94b tempest-VolumesNegativeTest-1427964725 tempest-VolumesNegativeTest-1427964725-project] 10.222.0.40 "GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722" status: 404 len: 111 microversion: 2.1 time: 0.032826 Jul 15 15:36:14.351328 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 381/756] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:36:14 2022] GET /compute/v2.1/servers/5346107a-1021-45e4-8e05-8a57a7757722 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:36:29.761639 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:36:29.762724 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:36:29.978358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-2171a27b-322f-4ddb-8a07-2b082cf00132 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Action: 'create', calling method: .version_select at 0x7fe3c691daf0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1986937243", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMPL1tJjfXgGdH1RI0DY5y121cY0qhb4j7eZwr8O63SDjASSU5EpP9SlJ2wWFkcUJrPgV1t5QPfboakBz0sFEtOuPvGQkwip13cEAl5Y3T/gvFg1NWz65t+rQUr0zJl7g=="}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:36:29.993375 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-2171a27b-322f-4ddb-8a07-2b082cf00132 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Getting quotas for project 9bda8b2837a54ec5a75c7dc355571255. Resources: {'key_pairs'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:36:29.998071 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-2171a27b-322f-4ddb-8a07-2b082cf00132 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Getting quotas for user 4453bd7126a849f29cfe3d8bdf4531f1 and project 9bda8b2837a54ec5a75c7dc355571255. Resources: {'key_pairs'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:36:30.024520 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-2171a27b-322f-4ddb-8a07-2b082cf00132 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.268094 Jul 15 15:36:30.025204 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 376/757] 10.222.0.40 () {60 vars in 1158 bytes} [Fri Jul 15 15:36:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:36:40.229748 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=22 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:36:40.231288 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=46 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:36:40.397435 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-bc8ce02a-a6c1-46d3-9039-b14069456bee tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:40.397919 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-bc8ce02a-a6c1-46d3-9039-b14069456bee tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:40.404506 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bc8ce02a-a6c1-46d3-9039-b14069456bee tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:40.404957 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bc8ce02a-a6c1-46d3-9039-b14069456bee tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:40.405740 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bc8ce02a-a6c1-46d3-9039-b14069456bee tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:40.406165 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bc8ce02a-a6c1-46d3-9039-b14069456bee tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:40.431083 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-bc8ce02a-a6c1-46d3-9039-b14069456bee tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add/ips" status: 200 len: 152 microversion: 2.20 time: 0.207300 Jul 15 15:36:40.431631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 382/758] 10.222.0.40 () {60 vars in 1288 bytes} [Fri Jul 15 15:36:40 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add/ips => generated 152 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 15 15:36:43.340353 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=4 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:36:43.341096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:36:43.346396 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-6a1d246e-8543-4e87-8f29-14baed09e25f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:36:43.346966 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-6a1d246e-8543-4e87-8f29-14baed09e25f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:43.354327 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6a1d246e-8543-4e87-8f29-14baed09e25f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:43.354854 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6a1d246e-8543-4e87-8f29-14baed09e25f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:43.355672 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6a1d246e-8543-4e87-8f29-14baed09e25f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:43.356103 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6a1d246e-8543-4e87-8f29-14baed09e25f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:43.384751 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.objects.instance [None req-6a1d246e-8543-4e87-8f29-14baed09e25f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lazy-loading 'flavor' on Instance uuid 0a2a79d6-dd6d-4d59-a58c-11252d834add {{(pid=117999) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:36:43.699341 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-6a1d246e-8543-4e87-8f29-14baed09e25f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "POST /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add/action" status: 202 len: 0 microversion: 2.20 time: 0.360113 Jul 15 15:36:43.699985 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 377/759] 10.222.0.40 () {62 vars in 1318 bytes} [Fri Jul 15 15:36:43 2022] POST /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 15 15:36:43.708741 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7d063da4-4a10-4d54-ba26-fda0f5cdceeb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:43.710012 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7d063da4-4a10-4d54-ba26-fda0f5cdceeb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:43.717663 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7d063da4-4a10-4d54-ba26-fda0f5cdceeb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:43.718167 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7d063da4-4a10-4d54-ba26-fda0f5cdceeb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:43.718971 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7d063da4-4a10-4d54-ba26-fda0f5cdceeb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:43.719768 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7d063da4-4a10-4d54-ba26-fda0f5cdceeb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:43.982728 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7d063da4-4a10-4d54-ba26-fda0f5cdceeb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:43.992075 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7d063da4-4a10-4d54-ba26-fda0f5cdceeb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:43.993146 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7d063da4-4a10-4d54-ba26-fda0f5cdceeb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:43.994410 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7d063da4-4a10-4d54-ba26-fda0f5cdceeb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1724 microversion: 2.20 time: 0.289728 Jul 15 15:36:43.995203 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 383/760] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:36:43 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:36:45.017050 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-6c1638e3-a4d1-4b59-b9ca-59adcf618d8e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:45.017748 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-6c1638e3-a4d1-4b59-b9ca-59adcf618d8e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:45.024999 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6c1638e3-a4d1-4b59-b9ca-59adcf618d8e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:45.025461 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6c1638e3-a4d1-4b59-b9ca-59adcf618d8e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:45.026227 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6c1638e3-a4d1-4b59-b9ca-59adcf618d8e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:45.026691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6c1638e3-a4d1-4b59-b9ca-59adcf618d8e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:45.181653 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6c1638e3-a4d1-4b59-b9ca-59adcf618d8e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:45.192077 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6c1638e3-a4d1-4b59-b9ca-59adcf618d8e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:45.193984 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6c1638e3-a4d1-4b59-b9ca-59adcf618d8e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:45.195178 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-6c1638e3-a4d1-4b59-b9ca-59adcf618d8e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1724 microversion: 2.20 time: 0.184495 Jul 15 15:36:45.195713 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 378/761] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:36:45 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:36:46.214856 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a5caa235-2df6-42d7-9978-c6a8fa105dcc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:46.215671 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a5caa235-2df6-42d7-9978-c6a8fa105dcc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:46.224051 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a5caa235-2df6-42d7-9978-c6a8fa105dcc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:46.224492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a5caa235-2df6-42d7-9978-c6a8fa105dcc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:46.225245 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a5caa235-2df6-42d7-9978-c6a8fa105dcc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:46.225672 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a5caa235-2df6-42d7-9978-c6a8fa105dcc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:46.361907 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a5caa235-2df6-42d7-9978-c6a8fa105dcc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:46.370390 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a5caa235-2df6-42d7-9978-c6a8fa105dcc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:46.371953 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a5caa235-2df6-42d7-9978-c6a8fa105dcc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:46.373109 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a5caa235-2df6-42d7-9978-c6a8fa105dcc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1724 microversion: 2.20 time: 0.163106 Jul 15 15:36:46.373664 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 384/762] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:36:46 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:36:47.394817 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-f60c5db1-50fe-4642-90f7-e4a20dcfb653 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:47.395435 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-f60c5db1-50fe-4642-90f7-e4a20dcfb653 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:47.402709 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f60c5db1-50fe-4642-90f7-e4a20dcfb653 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:47.403154 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f60c5db1-50fe-4642-90f7-e4a20dcfb653 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:47.403937 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f60c5db1-50fe-4642-90f7-e4a20dcfb653 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:47.404366 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-f60c5db1-50fe-4642-90f7-e4a20dcfb653 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:47.556376 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f60c5db1-50fe-4642-90f7-e4a20dcfb653 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:47.565286 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f60c5db1-50fe-4642-90f7-e4a20dcfb653 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:47.566813 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-f60c5db1-50fe-4642-90f7-e4a20dcfb653 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:47.567975 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-f60c5db1-50fe-4642-90f7-e4a20dcfb653 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1724 microversion: 2.20 time: 0.177306 Jul 15 15:36:47.568530 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 379/763] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:36:47 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:36:48.587281 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-52acce1c-bd38-4817-950a-75ef521653ad tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:48.587850 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-52acce1c-bd38-4817-950a-75ef521653ad tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:48.595282 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-52acce1c-bd38-4817-950a-75ef521653ad tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:48.595728 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-52acce1c-bd38-4817-950a-75ef521653ad tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:48.596499 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-52acce1c-bd38-4817-950a-75ef521653ad tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:48.596927 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-52acce1c-bd38-4817-950a-75ef521653ad tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:48.756817 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-52acce1c-bd38-4817-950a-75ef521653ad tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:48.765518 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-52acce1c-bd38-4817-950a-75ef521653ad tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:48.767522 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-52acce1c-bd38-4817-950a-75ef521653ad tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:48.768684 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-52acce1c-bd38-4817-950a-75ef521653ad tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1724 microversion: 2.20 time: 0.185547 Jul 15 15:36:48.769248 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 385/764] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:36:48 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:36:49.792210 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-b970a6ce-7ebe-44cd-9d06-1980a4a6333a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:49.793207 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-b970a6ce-7ebe-44cd-9d06-1980a4a6333a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:49.803475 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b970a6ce-7ebe-44cd-9d06-1980a4a6333a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:49.804081 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b970a6ce-7ebe-44cd-9d06-1980a4a6333a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:49.805315 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b970a6ce-7ebe-44cd-9d06-1980a4a6333a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:49.806021 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b970a6ce-7ebe-44cd-9d06-1980a4a6333a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:49.952449 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b970a6ce-7ebe-44cd-9d06-1980a4a6333a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:49.963674 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b970a6ce-7ebe-44cd-9d06-1980a4a6333a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:49.965386 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b970a6ce-7ebe-44cd-9d06-1980a4a6333a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:49.966550 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-b970a6ce-7ebe-44cd-9d06-1980a4a6333a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1724 microversion: 2.20 time: 0.182818 Jul 15 15:36:49.967263 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 380/765] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:36:49 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:36:50.986648 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6204d3f9-ce7c-4a2d-ba9d-4dbd62e403a2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:50.987256 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6204d3f9-ce7c-4a2d-ba9d-4dbd62e403a2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:50.994286 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6204d3f9-ce7c-4a2d-ba9d-4dbd62e403a2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:50.994771 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6204d3f9-ce7c-4a2d-ba9d-4dbd62e403a2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:50.995523 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6204d3f9-ce7c-4a2d-ba9d-4dbd62e403a2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:50.995948 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6204d3f9-ce7c-4a2d-ba9d-4dbd62e403a2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:51.149084 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6204d3f9-ce7c-4a2d-ba9d-4dbd62e403a2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:51.158863 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6204d3f9-ce7c-4a2d-ba9d-4dbd62e403a2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:51.161590 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6204d3f9-ce7c-4a2d-ba9d-4dbd62e403a2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:51.162790 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6204d3f9-ce7c-4a2d-ba9d-4dbd62e403a2 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1724 microversion: 2.20 time: 0.180541 Jul 15 15:36:51.163318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 386/766] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:36:50 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:36:52.185139 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-8fd94e8c-9079-432b-9cc6-112ed72febc6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:52.185760 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-8fd94e8c-9079-432b-9cc6-112ed72febc6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:52.192701 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8fd94e8c-9079-432b-9cc6-112ed72febc6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:52.193149 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8fd94e8c-9079-432b-9cc6-112ed72febc6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:52.193927 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8fd94e8c-9079-432b-9cc6-112ed72febc6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:52.194348 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8fd94e8c-9079-432b-9cc6-112ed72febc6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:52.345622 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-8fd94e8c-9079-432b-9cc6-112ed72febc6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:52.356137 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-8fd94e8c-9079-432b-9cc6-112ed72febc6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:52.357614 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-8fd94e8c-9079-432b-9cc6-112ed72febc6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:52.358835 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-8fd94e8c-9079-432b-9cc6-112ed72febc6 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1724 microversion: 2.20 time: 0.177830 Jul 15 15:36:52.359378 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 381/767] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:36:52 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:36:53.379165 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-92ebcd78-2de5-45d2-8265-68ad8a97de4b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:53.379779 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-92ebcd78-2de5-45d2-8265-68ad8a97de4b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:53.388736 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-92ebcd78-2de5-45d2-8265-68ad8a97de4b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:53.389165 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-92ebcd78-2de5-45d2-8265-68ad8a97de4b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:53.389992 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-92ebcd78-2de5-45d2-8265-68ad8a97de4b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:53.390339 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-92ebcd78-2de5-45d2-8265-68ad8a97de4b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:53.540258 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-92ebcd78-2de5-45d2-8265-68ad8a97de4b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:53.548741 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-92ebcd78-2de5-45d2-8265-68ad8a97de4b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:53.550335 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-92ebcd78-2de5-45d2-8265-68ad8a97de4b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:53.551522 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-92ebcd78-2de5-45d2-8265-68ad8a97de4b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1724 microversion: 2.20 time: 0.177544 Jul 15 15:36:53.552087 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 387/768] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:36:53 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:36:54.572807 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-eeed8de7-3eb4-49cb-945d-82e34b3222bb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:54.573358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-eeed8de7-3eb4-49cb-945d-82e34b3222bb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:54.582268 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-eeed8de7-3eb4-49cb-945d-82e34b3222bb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:54.582758 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-eeed8de7-3eb4-49cb-945d-82e34b3222bb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:54.583511 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-eeed8de7-3eb4-49cb-945d-82e34b3222bb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:54.583936 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-eeed8de7-3eb4-49cb-945d-82e34b3222bb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:54.729109 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-eeed8de7-3eb4-49cb-945d-82e34b3222bb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:54.742036 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-eeed8de7-3eb4-49cb-945d-82e34b3222bb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:54.744583 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-eeed8de7-3eb4-49cb-945d-82e34b3222bb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:54.746427 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-eeed8de7-3eb4-49cb-945d-82e34b3222bb tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1724 microversion: 2.20 time: 0.179621 Jul 15 15:36:54.747318 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 382/769] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:36:54 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:36:55.767420 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-82d8534b-f745-4509-9d49-9fd41455c81a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:55.768114 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-82d8534b-f745-4509-9d49-9fd41455c81a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:55.774983 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-82d8534b-f745-4509-9d49-9fd41455c81a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:55.775419 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-82d8534b-f745-4509-9d49-9fd41455c81a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:55.778225 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-82d8534b-f745-4509-9d49-9fd41455c81a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:55.778225 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-82d8534b-f745-4509-9d49-9fd41455c81a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:55.925725 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-82d8534b-f745-4509-9d49-9fd41455c81a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:55.936479 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-82d8534b-f745-4509-9d49-9fd41455c81a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:55.937975 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-82d8534b-f745-4509-9d49-9fd41455c81a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:55.939398 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-82d8534b-f745-4509-9d49-9fd41455c81a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1724 microversion: 2.20 time: 0.176045 Jul 15 15:36:55.940002 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 388/770] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:36:55 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:36:56.959561 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-30797514-a432-43e2-8925-3a37ac3ddb83 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:56.960212 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-30797514-a432-43e2-8925-3a37ac3ddb83 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:56.967234 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-30797514-a432-43e2-8925-3a37ac3ddb83 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:56.967734 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-30797514-a432-43e2-8925-3a37ac3ddb83 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:56.968707 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-30797514-a432-43e2-8925-3a37ac3ddb83 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:56.969237 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-30797514-a432-43e2-8925-3a37ac3ddb83 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:57.131833 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-30797514-a432-43e2-8925-3a37ac3ddb83 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:57.140652 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-30797514-a432-43e2-8925-3a37ac3ddb83 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:57.142169 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-30797514-a432-43e2-8925-3a37ac3ddb83 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:57.143379 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-30797514-a432-43e2-8925-3a37ac3ddb83 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1724 microversion: 2.20 time: 0.188697 Jul 15 15:36:57.143937 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 383/771] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:36:56 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:36:58.164017 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d21182e9-d8a6-4cca-8fb4-3f0d91c0ab3b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:58.164632 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d21182e9-d8a6-4cca-8fb4-3f0d91c0ab3b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:58.171426 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d21182e9-d8a6-4cca-8fb4-3f0d91c0ab3b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:58.171864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d21182e9-d8a6-4cca-8fb4-3f0d91c0ab3b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:58.172639 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d21182e9-d8a6-4cca-8fb4-3f0d91c0ab3b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:58.173061 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d21182e9-d8a6-4cca-8fb4-3f0d91c0ab3b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:58.335141 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d21182e9-d8a6-4cca-8fb4-3f0d91c0ab3b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:58.347100 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d21182e9-d8a6-4cca-8fb4-3f0d91c0ab3b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:58.348617 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d21182e9-d8a6-4cca-8fb4-3f0d91c0ab3b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:58.350425 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d21182e9-d8a6-4cca-8fb4-3f0d91c0ab3b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1724 microversion: 2.20 time: 0.191230 Jul 15 15:36:58.351226 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 389/772] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:36:58 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:36:58.409816 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-85c78beb-db0c-4c90-b988-2b65daa99986 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-482050390", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1986937243", "security_groups": [{"name": "tempest-secgroup-smoke-153259507"}], "block_device_mapping_v2": [{"uuid": "2b80b97a-06e6-4568-96bc-285acafff267", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9b60a386-f1f7-4772-81d0-41c3770d705b"}]}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:36:58.532352 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.network.neutron [None req-85c78beb-db0c-4c90-b988-2b65daa99986 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] validate_networks() for [('9b60a386-f1f7-4772-81d0-41c3770d705b', None, None, None, None, None)] {{(pid=117999) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:36:58.968733 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-85c78beb-db0c-4c90-b988-2b65daa99986 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Flavor limits 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:36:58.969245 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-85c78beb-db0c-4c90-b988-2b65daa99986 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Image limits 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:36:58.969920 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-85c78beb-db0c-4c90-b988-2b65daa99986 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Flavor pref 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:36:58.970514 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-85c78beb-db0c-4c90-b988-2b65daa99986 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Image pref 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:36:58.971109 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-85c78beb-db0c-4c90-b988-2b65daa99986 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:36:58.985486 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-85c78beb-db0c-4c90-b988-2b65daa99986 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:58.986112 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-85c78beb-db0c-4c90-b988-2b65daa99986 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:58.987882 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-85c78beb-db0c-4c90-b988-2b65daa99986 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:58.988576 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-85c78beb-db0c-4c90-b988-2b65daa99986 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:59.006918 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-85c78beb-db0c-4c90-b988-2b65daa99986 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Getting quotas for project 9bda8b2837a54ec5a75c7dc355571255. Resources: {'ram', 'instances', 'cores'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:36:59.011176 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-85c78beb-db0c-4c90-b988-2b65daa99986 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Getting quotas for user 4453bd7126a849f29cfe3d8bdf4531f1 and project 9bda8b2837a54ec5a75c7dc355571255. Resources: {'ram', 'instances', 'cores'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:36:59.068868 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-85c78beb-db0c-4c90-b988-2b65daa99986 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Going to run 1 instances... {{(pid=117999) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:36:59.070983 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-85c78beb-db0c-4c90-b988-2b65daa99986 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2b80b97a-06e6-4568-96bc-285acafff267',volume_size=None,volume_type=None)] {{(pid=117999) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:36:59.230682 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-85c78beb-db0c-4c90-b988-2b65daa99986 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.824650 Jul 15 15:36:59.231336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 384/773] 10.222.0.40 () {60 vars in 1146 bytes} [Fri Jul 15 15:36:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 15:36:59.242414 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-06072f0b-976d-4eef-abf2-c79ec580204e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:59.243192 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-06072f0b-976d-4eef-abf2-c79ec580204e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:59.298092 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-06072f0b-976d-4eef-abf2-c79ec580204e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:59.305510 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-06072f0b-976d-4eef-abf2-c79ec580204e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec" status: 200 len: 1094 microversion: 2.1 time: 0.067846 Jul 15 15:36:59.306377 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 390/774] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:36:59 2022] GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:36:59.375025 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-085d9273-616c-4079-a386-b74bcab78cf8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:36:59.375626 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-085d9273-616c-4079-a386-b74bcab78cf8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:36:59.382366 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-085d9273-616c-4079-a386-b74bcab78cf8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:59.382877 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-085d9273-616c-4079-a386-b74bcab78cf8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:59.383616 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-085d9273-616c-4079-a386-b74bcab78cf8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:36:59.384152 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-085d9273-616c-4079-a386-b74bcab78cf8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:36:59.526359 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-085d9273-616c-4079-a386-b74bcab78cf8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:59.534414 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-085d9273-616c-4079-a386-b74bcab78cf8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:59.535930 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-085d9273-616c-4079-a386-b74bcab78cf8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:36:59.537111 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-085d9273-616c-4079-a386-b74bcab78cf8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1724 microversion: 2.20 time: 0.166105 Jul 15 15:36:59.537811 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 385/775] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:36:59 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:00.326198 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5a06bfc8-95d3-4b3c-990a-a39cbf1932d4 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:00.326923 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5a06bfc8-95d3-4b3c-990a-a39cbf1932d4 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:00.336768 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5a06bfc8-95d3-4b3c-990a-a39cbf1932d4 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:00.337206 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5a06bfc8-95d3-4b3c-990a-a39cbf1932d4 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:00.337954 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5a06bfc8-95d3-4b3c-990a-a39cbf1932d4 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:00.338374 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5a06bfc8-95d3-4b3c-990a-a39cbf1932d4 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:00.421382 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5a06bfc8-95d3-4b3c-990a-a39cbf1932d4 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:00.431345 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5a06bfc8-95d3-4b3c-990a-a39cbf1932d4 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec" status: 200 len: 1192 microversion: 2.1 time: 0.111395 Jul 15 15:37:00.431937 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 391/776] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:37:00 2022] GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec => generated 1192 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:37:00.556439 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-ea195867-2356-498d-8951-b494e008374e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:00.557136 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-ea195867-2356-498d-8951-b494e008374e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:00.564329 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ea195867-2356-498d-8951-b494e008374e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:00.565285 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ea195867-2356-498d-8951-b494e008374e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:00.566063 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ea195867-2356-498d-8951-b494e008374e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:00.566666 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ea195867-2356-498d-8951-b494e008374e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:00.764692 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-ea195867-2356-498d-8951-b494e008374e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:00.773403 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-ea195867-2356-498d-8951-b494e008374e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:00.775051 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-ea195867-2356-498d-8951-b494e008374e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:00.776258 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-ea195867-2356-498d-8951-b494e008374e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1745 microversion: 2.20 time: 0.223920 Jul 15 15:37:00.776862 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 386/777] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:00 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1745 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:01.449617 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-48688f7e-82aa-4e30-9fb2-6256eaf6ac11 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:01.450231 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-48688f7e-82aa-4e30-9fb2-6256eaf6ac11 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:01.457435 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-48688f7e-82aa-4e30-9fb2-6256eaf6ac11 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:01.458201 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-48688f7e-82aa-4e30-9fb2-6256eaf6ac11 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:01.458996 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-48688f7e-82aa-4e30-9fb2-6256eaf6ac11 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:01.459839 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-48688f7e-82aa-4e30-9fb2-6256eaf6ac11 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:01.744596 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-48688f7e-82aa-4e30-9fb2-6256eaf6ac11 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:01.753411 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-48688f7e-82aa-4e30-9fb2-6256eaf6ac11 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec" status: 200 len: 1265 microversion: 2.1 time: 0.308513 Jul 15 15:37:01.754358 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 392/778] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:37:01 2022] GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec => generated 1265 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:37:01.795415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-bfb6b6a1-7e1e-4800-992e-65b10da8dd2a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:01.796027 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-bfb6b6a1-7e1e-4800-992e-65b10da8dd2a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:01.802830 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bfb6b6a1-7e1e-4800-992e-65b10da8dd2a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:01.803601 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bfb6b6a1-7e1e-4800-992e-65b10da8dd2a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:01.804472 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bfb6b6a1-7e1e-4800-992e-65b10da8dd2a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:01.805129 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bfb6b6a1-7e1e-4800-992e-65b10da8dd2a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:02.022213 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-bfb6b6a1-7e1e-4800-992e-65b10da8dd2a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:02.032584 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-bfb6b6a1-7e1e-4800-992e-65b10da8dd2a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:02.034505 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-bfb6b6a1-7e1e-4800-992e-65b10da8dd2a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:02.035975 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-bfb6b6a1-7e1e-4800-992e-65b10da8dd2a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1745 microversion: 2.20 time: 0.244515 Jul 15 15:37:02.037068 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 387/779] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:01 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1745 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:02.234813 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-c936fe0e-4d5e-4d99-bd6b-38f55f7b884a req-b1cd5ac0-1d93-41aa-a8d6-9b999bca6b00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec", "tag": "51cdf260-8522-4ae6-84c4-b058d8c52d32"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:37:02.250454 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-c936fe0e-4d5e-4d99-bd6b-38f55f7b884a req-b1cd5ac0-1d93-41aa-a8d6-9b999bca6b00 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:02.252038 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-c936fe0e-4d5e-4d99-bd6b-38f55f7b884a req-b1cd5ac0-1d93-41aa-a8d6-9b999bca6b00 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:02.279881 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-c936fe0e-4d5e-4d99-bd6b-38f55f7b884a req-b1cd5ac0-1d93-41aa-a8d6-9b999bca6b00 service nova] Creating event network-changed:51cdf260-8522-4ae6-84c4-b058d8c52d32 for instance e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec on hv-cinder-85001 Jul 15 15:37:02.285147 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-c936fe0e-4d5e-4d99-bd6b-38f55f7b884a req-b1cd5ac0-1d93-41aa-a8d6-9b999bca6b00 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054918 Jul 15 15:37:02.285745 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 393/780] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:37:02.771742 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-eacb95ac-c97f-4d67-9e38-00a6ae35e503 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:02.772357 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-eacb95ac-c97f-4d67-9e38-00a6ae35e503 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:02.778942 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-eacb95ac-c97f-4d67-9e38-00a6ae35e503 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:02.779328 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-eacb95ac-c97f-4d67-9e38-00a6ae35e503 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:02.780090 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-eacb95ac-c97f-4d67-9e38-00a6ae35e503 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:02.780503 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-eacb95ac-c97f-4d67-9e38-00a6ae35e503 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:02.927183 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-eacb95ac-c97f-4d67-9e38-00a6ae35e503 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:02.938731 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-eacb95ac-c97f-4d67-9e38-00a6ae35e503 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec" status: 200 len: 1265 microversion: 2.1 time: 0.171224 Jul 15 15:37:02.939303 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 388/781] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:37:02 2022] GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:37:03.058149 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-43b04342-8e91-45c9-a55a-f371bcf12d16 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:03.058949 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-43b04342-8e91-45c9-a55a-f371bcf12d16 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:03.068238 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-43b04342-8e91-45c9-a55a-f371bcf12d16 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:03.068813 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-43b04342-8e91-45c9-a55a-f371bcf12d16 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:03.070093 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-43b04342-8e91-45c9-a55a-f371bcf12d16 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:03.070545 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-43b04342-8e91-45c9-a55a-f371bcf12d16 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:03.229555 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-43b04342-8e91-45c9-a55a-f371bcf12d16 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:03.237789 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-43b04342-8e91-45c9-a55a-f371bcf12d16 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:03.239324 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-43b04342-8e91-45c9-a55a-f371bcf12d16 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:03.240487 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-43b04342-8e91-45c9-a55a-f371bcf12d16 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1745 microversion: 2.20 time: 0.188576 Jul 15 15:37:03.241052 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 394/782] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:03 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1745 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:03.902705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-d0ccc724-c668-4e8f-8ce6-7e054032c1de req-007d9e7c-6e0f-4518-b991-43e63e79e17b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a2a79d6-dd6d-4d59-a58c-11252d834add", "name": "network-vif-plugged", "status": "completed", "tag": "06b33828-c90f-45fb-839b-8fd1808f8a80"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:37:03.912839 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-d0ccc724-c668-4e8f-8ce6-7e054032c1de req-007d9e7c-6e0f-4518-b991-43e63e79e17b service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:03.913379 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-d0ccc724-c668-4e8f-8ce6-7e054032c1de req-007d9e7c-6e0f-4518-b991-43e63e79e17b service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:03.925110 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-d0ccc724-c668-4e8f-8ce6-7e054032c1de req-007d9e7c-6e0f-4518-b991-43e63e79e17b service nova] Creating event network-vif-plugged:06b33828-c90f-45fb-839b-8fd1808f8a80 for instance 0a2a79d6-dd6d-4d59-a58c-11252d834add on hv-cinder-85001 Jul 15 15:37:03.930232 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-d0ccc724-c668-4e8f-8ce6-7e054032c1de req-007d9e7c-6e0f-4518-b991-43e63e79e17b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032117 Jul 15 15:37:03.930900 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 389/783] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:37:03.955758 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f40f39d3-57d7-459b-801a-e3e9c89e15a9 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:03.956386 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f40f39d3-57d7-459b-801a-e3e9c89e15a9 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:03.963479 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f40f39d3-57d7-459b-801a-e3e9c89e15a9 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:03.963919 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f40f39d3-57d7-459b-801a-e3e9c89e15a9 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:03.964738 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f40f39d3-57d7-459b-801a-e3e9c89e15a9 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:03.965456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f40f39d3-57d7-459b-801a-e3e9c89e15a9 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:04.176574 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f40f39d3-57d7-459b-801a-e3e9c89e15a9 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:04.184760 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f40f39d3-57d7-459b-801a-e3e9c89e15a9 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec" status: 200 len: 1265 microversion: 2.1 time: 0.233052 Jul 15 15:37:04.185316 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 395/784] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:37:03 2022] GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:37:04.260196 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-1b252299-c669-4aa9-9cfe-1775eb197f54 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:04.260831 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-1b252299-c669-4aa9-9cfe-1775eb197f54 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:04.267472 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1b252299-c669-4aa9-9cfe-1775eb197f54 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:04.267972 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1b252299-c669-4aa9-9cfe-1775eb197f54 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:04.268730 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1b252299-c669-4aa9-9cfe-1775eb197f54 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:04.269130 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1b252299-c669-4aa9-9cfe-1775eb197f54 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:04.485785 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1b252299-c669-4aa9-9cfe-1775eb197f54 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:04.494426 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1b252299-c669-4aa9-9cfe-1775eb197f54 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:04.495928 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1b252299-c669-4aa9-9cfe-1775eb197f54 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:04.497102 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-1b252299-c669-4aa9-9cfe-1775eb197f54 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1745 microversion: 2.20 time: 0.241675 Jul 15 15:37:04.497663 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 390/785] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:04 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1745 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:05.203759 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4caaad45-fa12-4e9c-9751-3a0152e53e77 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:05.204628 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-4caaad45-fa12-4e9c-9751-3a0152e53e77 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:05.214445 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4caaad45-fa12-4e9c-9751-3a0152e53e77 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:05.215247 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4caaad45-fa12-4e9c-9751-3a0152e53e77 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:05.216441 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4caaad45-fa12-4e9c-9751-3a0152e53e77 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:05.217049 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4caaad45-fa12-4e9c-9751-3a0152e53e77 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:05.363278 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-4caaad45-fa12-4e9c-9751-3a0152e53e77 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:05.374580 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4caaad45-fa12-4e9c-9751-3a0152e53e77 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec" status: 200 len: 1265 microversion: 2.1 time: 0.176174 Jul 15 15:37:05.375470 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 396/786] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:37:05 2022] GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:37:05.520323 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-4ce614da-a4f9-44c4-832d-2202d33273a9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:05.521211 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-4ce614da-a4f9-44c4-832d-2202d33273a9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:05.529141 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4ce614da-a4f9-44c4-832d-2202d33273a9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:05.529582 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4ce614da-a4f9-44c4-832d-2202d33273a9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:05.530356 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4ce614da-a4f9-44c4-832d-2202d33273a9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:05.530824 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4ce614da-a4f9-44c4-832d-2202d33273a9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:05.680630 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-4ce614da-a4f9-44c4-832d-2202d33273a9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:05.688691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-4ce614da-a4f9-44c4-832d-2202d33273a9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:05.690214 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-4ce614da-a4f9-44c4-832d-2202d33273a9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:05.691429 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-4ce614da-a4f9-44c4-832d-2202d33273a9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1745 microversion: 2.20 time: 0.178008 Jul 15 15:37:05.691972 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 391/787] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:05 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:06.394780 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f02b4eb4-786e-4e71-93bc-798b1306e6a0 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:06.395377 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f02b4eb4-786e-4e71-93bc-798b1306e6a0 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:06.402456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f02b4eb4-786e-4e71-93bc-798b1306e6a0 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:06.403032 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f02b4eb4-786e-4e71-93bc-798b1306e6a0 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:06.403761 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f02b4eb4-786e-4e71-93bc-798b1306e6a0 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:06.404187 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f02b4eb4-786e-4e71-93bc-798b1306e6a0 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:06.555607 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f02b4eb4-786e-4e71-93bc-798b1306e6a0 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:06.564232 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f02b4eb4-786e-4e71-93bc-798b1306e6a0 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec" status: 200 len: 1265 microversion: 2.1 time: 0.173473 Jul 15 15:37:06.564799 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 397/788] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:37:06 2022] GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:37:06.713102 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-5a458d3c-ed3d-4f12-8ad5-68ae6d4d94ec tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:06.713718 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-5a458d3c-ed3d-4f12-8ad5-68ae6d4d94ec tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:06.720415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5a458d3c-ed3d-4f12-8ad5-68ae6d4d94ec tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:06.720863 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5a458d3c-ed3d-4f12-8ad5-68ae6d4d94ec tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:06.721621 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5a458d3c-ed3d-4f12-8ad5-68ae6d4d94ec tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:06.722051 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5a458d3c-ed3d-4f12-8ad5-68ae6d4d94ec tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:06.859727 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-5a458d3c-ed3d-4f12-8ad5-68ae6d4d94ec tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:06.865092 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:06.870810 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-5a458d3c-ed3d-4f12-8ad5-68ae6d4d94ec tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:06.872288 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-5a458d3c-ed3d-4f12-8ad5-68ae6d4d94ec tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:06.873442 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-5a458d3c-ed3d-4f12-8ad5-68ae6d4d94ec tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1745 microversion: 2.20 time: 0.164509 Jul 15 15:37:06.873991 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 392/789] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:06 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:07.581551 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-dbb26eb2-a17b-40ac-a8cc-c84097d14716 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:07.582170 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-dbb26eb2-a17b-40ac-a8cc-c84097d14716 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:07.589985 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dbb26eb2-a17b-40ac-a8cc-c84097d14716 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:07.590430 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dbb26eb2-a17b-40ac-a8cc-c84097d14716 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:07.591228 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dbb26eb2-a17b-40ac-a8cc-c84097d14716 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:07.591659 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dbb26eb2-a17b-40ac-a8cc-c84097d14716 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:07.736908 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-dbb26eb2-a17b-40ac-a8cc-c84097d14716 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:07.747372 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-dbb26eb2-a17b-40ac-a8cc-c84097d14716 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec" status: 200 len: 1265 microversion: 2.1 time: 0.169781 Jul 15 15:37:07.748297 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 398/790] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:37:07 2022] GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:37:07.892943 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-87a636c5-52e6-43d1-ad94-968d67014d7d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:07.893565 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-87a636c5-52e6-43d1-ad94-968d67014d7d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:07.903463 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-87a636c5-52e6-43d1-ad94-968d67014d7d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:07.904086 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-87a636c5-52e6-43d1-ad94-968d67014d7d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:07.905309 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-87a636c5-52e6-43d1-ad94-968d67014d7d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:07.905838 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-87a636c5-52e6-43d1-ad94-968d67014d7d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:08.044969 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-87a636c5-52e6-43d1-ad94-968d67014d7d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:08.053124 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-87a636c5-52e6-43d1-ad94-968d67014d7d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:08.054721 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-87a636c5-52e6-43d1-ad94-968d67014d7d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:08.056040 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-87a636c5-52e6-43d1-ad94-968d67014d7d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1740 microversion: 2.20 time: 0.167090 Jul 15 15:37:08.056807 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 393/791] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:07 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:08.765503 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2681ffc2-0f17-48dc-9c1c-ff8683d03238 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:08.766865 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-2681ffc2-0f17-48dc-9c1c-ff8683d03238 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:08.774281 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2681ffc2-0f17-48dc-9c1c-ff8683d03238 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:08.775046 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2681ffc2-0f17-48dc-9c1c-ff8683d03238 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:08.776432 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2681ffc2-0f17-48dc-9c1c-ff8683d03238 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:08.776580 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2681ffc2-0f17-48dc-9c1c-ff8683d03238 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:08.930780 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2681ffc2-0f17-48dc-9c1c-ff8683d03238 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:08.949591 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-2681ffc2-0f17-48dc-9c1c-ff8683d03238 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec" status: 200 len: 1265 microversion: 2.1 time: 0.188603 Jul 15 15:37:08.950363 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 399/792] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:37:08 2022] GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:37:09.077254 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-dec3785b-f8ba-4a62-bbe7-98f92947fe28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:09.078282 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-dec3785b-f8ba-4a62-bbe7-98f92947fe28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:09.088777 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=2 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:09.090017 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=6 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:09.092889 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-dec3785b-f8ba-4a62-bbe7-98f92947fe28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:09.093284 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-dec3785b-f8ba-4a62-bbe7-98f92947fe28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:09.094223 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-dec3785b-f8ba-4a62-bbe7-98f92947fe28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:09.094646 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-dec3785b-f8ba-4a62-bbe7-98f92947fe28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:09.243812 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-dec3785b-f8ba-4a62-bbe7-98f92947fe28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:09.253288 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-dec3785b-f8ba-4a62-bbe7-98f92947fe28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:09.254934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-dec3785b-f8ba-4a62-bbe7-98f92947fe28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:09.256201 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-dec3785b-f8ba-4a62-bbe7-98f92947fe28 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1740 microversion: 2.20 time: 0.185544 Jul 15 15:37:09.257079 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 394/793] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:09 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:09.968273 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-91854108-c83b-42d4-b89e-e4efeb434b2a tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:09.968895 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-91854108-c83b-42d4-b89e-e4efeb434b2a tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:09.970909 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:09.977091 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-91854108-c83b-42d4-b89e-e4efeb434b2a tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:09.977532 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-91854108-c83b-42d4-b89e-e4efeb434b2a tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:09.978295 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-91854108-c83b-42d4-b89e-e4efeb434b2a tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:09.978761 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-91854108-c83b-42d4-b89e-e4efeb434b2a tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:09.997470 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=100 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:10.114815 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-91854108-c83b-42d4-b89e-e4efeb434b2a tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:10.122703 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-91854108-c83b-42d4-b89e-e4efeb434b2a tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec" status: 200 len: 1265 microversion: 2.1 time: 0.158325 Jul 15 15:37:10.123560 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 400/794] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:37:09 2022] GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:37:10.277051 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-a9b0c4e0-0b59-4366-9bd1-ecc05f7705ee tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:10.278449 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-a9b0c4e0-0b59-4366-9bd1-ecc05f7705ee tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:10.286710 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a9b0c4e0-0b59-4366-9bd1-ecc05f7705ee tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:10.287500 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a9b0c4e0-0b59-4366-9bd1-ecc05f7705ee tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:10.288286 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a9b0c4e0-0b59-4366-9bd1-ecc05f7705ee tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:10.289164 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a9b0c4e0-0b59-4366-9bd1-ecc05f7705ee tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:10.449481 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-a9b0c4e0-0b59-4366-9bd1-ecc05f7705ee tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:10.458292 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-a9b0c4e0-0b59-4366-9bd1-ecc05f7705ee tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:10.460785 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-a9b0c4e0-0b59-4366-9bd1-ecc05f7705ee tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:10.460977 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-a9b0c4e0-0b59-4366-9bd1-ecc05f7705ee tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1740 microversion: 2.20 time: 0.190112 Jul 15 15:37:10.461836 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 395/795] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:10 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:11.140631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6bcec6c1-a130-4ab7-958c-976a9b365033 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:11.141290 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6bcec6c1-a130-4ab7-958c-976a9b365033 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:11.143189 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=41 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:11.148456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6bcec6c1-a130-4ab7-958c-976a9b365033 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:11.148900 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6bcec6c1-a130-4ab7-958c-976a9b365033 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:11.149655 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6bcec6c1-a130-4ab7-958c-976a9b365033 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:11.150115 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6bcec6c1-a130-4ab7-958c-976a9b365033 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:11.299976 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6bcec6c1-a130-4ab7-958c-976a9b365033 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:11.309005 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6bcec6c1-a130-4ab7-958c-976a9b365033 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec" status: 200 len: 1265 microversion: 2.1 time: 0.172786 Jul 15 15:37:11.314815 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 401/796] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:37:11 2022] GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:37:11.481410 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-827c7221-4d3b-4b75-af75-fa3456e89efc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:11.482881 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-827c7221-4d3b-4b75-af75-fa3456e89efc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:11.489937 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-827c7221-4d3b-4b75-af75-fa3456e89efc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:11.490305 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-827c7221-4d3b-4b75-af75-fa3456e89efc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:11.491284 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-827c7221-4d3b-4b75-af75-fa3456e89efc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:11.491914 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-827c7221-4d3b-4b75-af75-fa3456e89efc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:11.657736 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-827c7221-4d3b-4b75-af75-fa3456e89efc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:11.666978 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-827c7221-4d3b-4b75-af75-fa3456e89efc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:11.668893 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-827c7221-4d3b-4b75-af75-fa3456e89efc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:11.670062 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-827c7221-4d3b-4b75-af75-fa3456e89efc tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1740 microversion: 2.20 time: 0.193128 Jul 15 15:37:11.670646 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 396/797] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:11 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:12.332755 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d26f19ea-aa9c-43ad-8c99-e78b8ea74006 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:12.333737 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d26f19ea-aa9c-43ad-8c99-e78b8ea74006 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:12.341611 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d26f19ea-aa9c-43ad-8c99-e78b8ea74006 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:12.342039 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d26f19ea-aa9c-43ad-8c99-e78b8ea74006 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:12.342829 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d26f19ea-aa9c-43ad-8c99-e78b8ea74006 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:12.343277 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d26f19ea-aa9c-43ad-8c99-e78b8ea74006 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:12.507245 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d26f19ea-aa9c-43ad-8c99-e78b8ea74006 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:12.520830 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d26f19ea-aa9c-43ad-8c99-e78b8ea74006 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec" status: 200 len: 1265 microversion: 2.1 time: 0.198244 Jul 15 15:37:12.531694 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 402/798] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:37:12 2022] GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:37:12.697739 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-cf0d214a-0b1d-4b09-883a-f6c33f3dc7f7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:12.698352 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-cf0d214a-0b1d-4b09-883a-f6c33f3dc7f7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:12.710911 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cf0d214a-0b1d-4b09-883a-f6c33f3dc7f7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:12.711654 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cf0d214a-0b1d-4b09-883a-f6c33f3dc7f7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:12.712610 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cf0d214a-0b1d-4b09-883a-f6c33f3dc7f7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:12.718886 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cf0d214a-0b1d-4b09-883a-f6c33f3dc7f7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:12.876898 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-cf0d214a-0b1d-4b09-883a-f6c33f3dc7f7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:12.885759 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-cf0d214a-0b1d-4b09-883a-f6c33f3dc7f7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:12.887405 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-cf0d214a-0b1d-4b09-883a-f6c33f3dc7f7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:12.888651 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-cf0d214a-0b1d-4b09-883a-f6c33f3dc7f7 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1740 microversion: 2.20 time: 0.195201 Jul 15 15:37:12.889776 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 397/799] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:12 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1740 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:13.538607 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3420b7cb-df86-42e1-bd4f-26b064286d55 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:13.539953 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3420b7cb-df86-42e1-bd4f-26b064286d55 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:13.547499 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3420b7cb-df86-42e1-bd4f-26b064286d55 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:13.547926 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3420b7cb-df86-42e1-bd4f-26b064286d55 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:13.548689 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3420b7cb-df86-42e1-bd4f-26b064286d55 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:13.549113 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3420b7cb-df86-42e1-bd4f-26b064286d55 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:13.698123 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3420b7cb-df86-42e1-bd4f-26b064286d55 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:13.708970 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3420b7cb-df86-42e1-bd4f-26b064286d55 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec" status: 200 len: 1265 microversion: 2.1 time: 0.173760 Jul 15 15:37:13.709839 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 403/800] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:37:13 2022] GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:37:13.907855 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-cbba2a82-b900-4a45-8dc8-9413a6bd54ba tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:13.909245 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-cbba2a82-b900-4a45-8dc8-9413a6bd54ba tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:13.915226 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:13.917805 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cbba2a82-b900-4a45-8dc8-9413a6bd54ba tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:13.918847 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cbba2a82-b900-4a45-8dc8-9413a6bd54ba tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:13.920315 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cbba2a82-b900-4a45-8dc8-9413a6bd54ba tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:13.921254 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cbba2a82-b900-4a45-8dc8-9413a6bd54ba tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:13.984879 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-3ca3b8f5-eecf-47c0-87d9-ed59bfce1588 req-70e84aa8-2c4f-46fb-90a3-fe8dc2f59baa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec", "name": "network-vif-plugged", "status": "completed", "tag": "51cdf260-8522-4ae6-84c4-b058d8c52d32"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:37:13.994966 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-3ca3b8f5-eecf-47c0-87d9-ed59bfce1588 req-70e84aa8-2c4f-46fb-90a3-fe8dc2f59baa service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:13.995580 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-3ca3b8f5-eecf-47c0-87d9-ed59bfce1588 req-70e84aa8-2c4f-46fb-90a3-fe8dc2f59baa service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:14.021760 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-3ca3b8f5-eecf-47c0-87d9-ed59bfce1588 req-70e84aa8-2c4f-46fb-90a3-fe8dc2f59baa service nova] Creating event network-vif-plugged:51cdf260-8522-4ae6-84c4-b058d8c52d32 for instance e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec on hv-cinder-85001 Jul 15 15:37:14.027391 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-3ca3b8f5-eecf-47c0-87d9-ed59bfce1588 req-70e84aa8-2c4f-46fb-90a3-fe8dc2f59baa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046455 Jul 15 15:37:14.029507 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 404/801] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:37:14.168867 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-cbba2a82-b900-4a45-8dc8-9413a6bd54ba tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:14.183925 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-cbba2a82-b900-4a45-8dc8-9413a6bd54ba tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:14.185815 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-cbba2a82-b900-4a45-8dc8-9413a6bd54ba tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:14.187692 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-cbba2a82-b900-4a45-8dc8-9413a6bd54ba tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1740 microversion: 2.20 time: 0.283613 Jul 15 15:37:14.199103 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 398/802] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:13 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1740 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:14.727723 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-52a0fb3e-1da2-433c-83e1-b8584abc1acd tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:14.728444 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-52a0fb3e-1da2-433c-83e1-b8584abc1acd tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:14.737342 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-52a0fb3e-1da2-433c-83e1-b8584abc1acd tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:14.737781 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-52a0fb3e-1da2-433c-83e1-b8584abc1acd tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:14.738616 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-52a0fb3e-1da2-433c-83e1-b8584abc1acd tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:14.739037 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-52a0fb3e-1da2-433c-83e1-b8584abc1acd tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:14.884806 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-52a0fb3e-1da2-433c-83e1-b8584abc1acd tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:14.893474 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-52a0fb3e-1da2-433c-83e1-b8584abc1acd tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec" status: 200 len: 1265 microversion: 2.1 time: 0.170542 Jul 15 15:37:14.894092 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 405/803] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:37:14 2022] GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:37:15.132421 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-e55e3c1c-117e-4625-8f65-a226aabede48 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:15.132920 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-e55e3c1c-117e-4625-8f65-a226aabede48 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:15.139617 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e55e3c1c-117e-4625-8f65-a226aabede48 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:15.140324 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e55e3c1c-117e-4625-8f65-a226aabede48 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:15.141262 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e55e3c1c-117e-4625-8f65-a226aabede48 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:15.142762 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e55e3c1c-117e-4625-8f65-a226aabede48 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:15.171215 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-e55e3c1c-117e-4625-8f65-a226aabede48 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592/ips" status: 200 len: 146 microversion: 2.1 time: 0.202475 Jul 15 15:37:15.172166 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 399/804] 10.222.0.40 () {58 vars in 1247 bytes} [Fri Jul 15 15:37:14 2022] GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592/ips => generated 146 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:37:15.210230 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9faafccd-6fb1-4377-b8b7-4148f08f4737 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:15.211173 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9faafccd-6fb1-4377-b8b7-4148f08f4737 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:15.219301 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9faafccd-6fb1-4377-b8b7-4148f08f4737 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:15.220233 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9faafccd-6fb1-4377-b8b7-4148f08f4737 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:15.221080 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9faafccd-6fb1-4377-b8b7-4148f08f4737 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:15.221869 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9faafccd-6fb1-4377-b8b7-4148f08f4737 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:15.403490 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9faafccd-6fb1-4377-b8b7-4148f08f4737 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:15.414037 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9faafccd-6fb1-4377-b8b7-4148f08f4737 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:15.416377 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9faafccd-6fb1-4377-b8b7-4148f08f4737 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:15.419257 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9faafccd-6fb1-4377-b8b7-4148f08f4737 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1740 microversion: 2.20 time: 0.213402 Jul 15 15:37:15.420427 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 406/805] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:15 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1740 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:15.911943 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-5d5f3536-f2f2-467c-a0a7-1abda525bb65 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:15.913657 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-5d5f3536-f2f2-467c-a0a7-1abda525bb65 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:15.929921 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5d5f3536-f2f2-467c-a0a7-1abda525bb65 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:15.937994 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5d5f3536-f2f2-467c-a0a7-1abda525bb65 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:15.945635 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5d5f3536-f2f2-467c-a0a7-1abda525bb65 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:15.946096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5d5f3536-f2f2-467c-a0a7-1abda525bb65 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:16.116195 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-5d5f3536-f2f2-467c-a0a7-1abda525bb65 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:16.126070 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-5d5f3536-f2f2-467c-a0a7-1abda525bb65 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec" status: 200 len: 1265 microversion: 2.1 time: 0.218361 Jul 15 15:37:16.127459 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 400/806] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:37:15 2022] GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:37:16.440125 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c6e64d7c-65de-4c09-a783-fd4597269427 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:16.440932 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-c6e64d7c-65de-4c09-a783-fd4597269427 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:16.448012 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c6e64d7c-65de-4c09-a783-fd4597269427 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:16.448805 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c6e64d7c-65de-4c09-a783-fd4597269427 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:16.450026 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c6e64d7c-65de-4c09-a783-fd4597269427 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:16.450545 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c6e64d7c-65de-4c09-a783-fd4597269427 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:16.601878 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c6e64d7c-65de-4c09-a783-fd4597269427 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:16.614733 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c6e64d7c-65de-4c09-a783-fd4597269427 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:16.614733 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c6e64d7c-65de-4c09-a783-fd4597269427 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:16.615666 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-c6e64d7c-65de-4c09-a783-fd4597269427 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1740 microversion: 2.20 time: 0.180163 Jul 15 15:37:16.616318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 407/807] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:16 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:16.639858 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-61ebc034-1bcd-49ad-90aa-d985d7e45119 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccc2a315-697e-4c22-9036-bbd450830e04"}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:37:16.641719 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-61ebc034-1bcd-49ad-90aa-d985d7e45119 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:16.648430 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-61ebc034-1bcd-49ad-90aa-d985d7e45119 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:16.648954 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-61ebc034-1bcd-49ad-90aa-d985d7e45119 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:16.649824 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-61ebc034-1bcd-49ad-90aa-d985d7e45119 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:16.650349 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-61ebc034-1bcd-49ad-90aa-d985d7e45119 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:16.964880 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-61ebc034-1bcd-49ad-90aa-d985d7e45119 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "POST /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329010 Jul 15 15:37:16.966593 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 401/808] 10.222.0.40 () {60 vars in 1322 bytes} [Fri Jul 15 15:37:16 2022] POST /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:37:17.145399 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4d68b29e-470a-4121-8b11-3ab4f5dba486 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:17.146268 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-4d68b29e-470a-4121-8b11-3ab4f5dba486 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:17.155869 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4d68b29e-470a-4121-8b11-3ab4f5dba486 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:17.156315 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4d68b29e-470a-4121-8b11-3ab4f5dba486 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:17.157080 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4d68b29e-470a-4121-8b11-3ab4f5dba486 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:17.157511 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4d68b29e-470a-4121-8b11-3ab4f5dba486 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:17.591255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-4d68b29e-470a-4121-8b11-3ab4f5dba486 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:17.600916 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4d68b29e-470a-4121-8b11-3ab4f5dba486 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec" status: 200 len: 1451 microversion: 2.1 time: 0.460715 Jul 15 15:37:17.602146 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 408/809] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:37:17 2022] GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec => generated 1451 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:37:17.621233 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-578c5f68-c481-4a55-aeb5-ddd5f3ca6999 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:17.622327 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-578c5f68-c481-4a55-aeb5-ddd5f3ca6999 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:17.632728 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-578c5f68-c481-4a55-aeb5-ddd5f3ca6999 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:17.634041 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-578c5f68-c481-4a55-aeb5-ddd5f3ca6999 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:17.635125 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-578c5f68-c481-4a55-aeb5-ddd5f3ca6999 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:17.638129 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-578c5f68-c481-4a55-aeb5-ddd5f3ca6999 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:17.643689 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-def8aaa6-78ae-4869-8d90-eb17a8ee063c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:17.644376 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-def8aaa6-78ae-4869-8d90-eb17a8ee063c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:17.651375 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-def8aaa6-78ae-4869-8d90-eb17a8ee063c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:17.651902 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-def8aaa6-78ae-4869-8d90-eb17a8ee063c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:17.653073 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-def8aaa6-78ae-4869-8d90-eb17a8ee063c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:17.653752 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-def8aaa6-78ae-4869-8d90-eb17a8ee063c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:17.871649 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-578c5f68-c481-4a55-aeb5-ddd5f3ca6999 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:17.881225 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-578c5f68-c481-4a55-aeb5-ddd5f3ca6999 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec" status: 200 len: 1451 microversion: 2.1 time: 0.264694 Jul 15 15:37:17.881951 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 402/810] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:37:17 2022] GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec => generated 1451 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:37:17.883113 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-def8aaa6-78ae-4869-8d90-eb17a8ee063c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:17.894864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-def8aaa6-78ae-4869-8d90-eb17a8ee063c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:17.894864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-def8aaa6-78ae-4869-8d90-eb17a8ee063c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:17.895313 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-def8aaa6-78ae-4869-8d90-eb17a8ee063c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1740 microversion: 2.20 time: 0.255899 Jul 15 15:37:17.895981 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 409/811] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:17 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1740 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:18.914504 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-6025a40a-48db-4a7d-818e-55552e75bf0e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:18.915198 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-6025a40a-48db-4a7d-818e-55552e75bf0e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:18.924132 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6025a40a-48db-4a7d-818e-55552e75bf0e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:18.924557 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6025a40a-48db-4a7d-818e-55552e75bf0e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:18.925411 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6025a40a-48db-4a7d-818e-55552e75bf0e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:18.925841 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6025a40a-48db-4a7d-818e-55552e75bf0e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:19.152194 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6025a40a-48db-4a7d-818e-55552e75bf0e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:19.161674 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6025a40a-48db-4a7d-818e-55552e75bf0e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:19.163402 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6025a40a-48db-4a7d-818e-55552e75bf0e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:19.164770 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-6025a40a-48db-4a7d-818e-55552e75bf0e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1740 microversion: 2.20 time: 0.254434 Jul 15 15:37:19.165326 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 403/812] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:18 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1740 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 15:37:19.811566 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-2bbd7f63-fdbd-4a88-a5ec-6e1800806532 req-33ae07a0-884d-4892-b37c-646a4918918c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec", "tag": "51cdf260-8522-4ae6-84c4-b058d8c52d32"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:37:19.822844 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-2bbd7f63-fdbd-4a88-a5ec-6e1800806532 req-33ae07a0-884d-4892-b37c-646a4918918c service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:19.823361 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-2bbd7f63-fdbd-4a88-a5ec-6e1800806532 req-33ae07a0-884d-4892-b37c-646a4918918c service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:19.835714 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-2bbd7f63-fdbd-4a88-a5ec-6e1800806532 req-33ae07a0-884d-4892-b37c-646a4918918c service nova] Creating event network-changed:51cdf260-8522-4ae6-84c4-b058d8c52d32 for instance e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec on hv-cinder-85001 Jul 15 15:37:19.840679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-2bbd7f63-fdbd-4a88-a5ec-6e1800806532 req-33ae07a0-884d-4892-b37c-646a4918918c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033122 Jul 15 15:37:19.841440 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 410/813] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:37:20.184616 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-b1b6e491-e727-46df-9942-39fe53820167 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:20.185319 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-b1b6e491-e727-46df-9942-39fe53820167 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:20.192499 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b1b6e491-e727-46df-9942-39fe53820167 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:20.193146 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b1b6e491-e727-46df-9942-39fe53820167 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:20.194224 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b1b6e491-e727-46df-9942-39fe53820167 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:20.194843 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b1b6e491-e727-46df-9942-39fe53820167 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:20.505984 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b1b6e491-e727-46df-9942-39fe53820167 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:20.515404 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b1b6e491-e727-46df-9942-39fe53820167 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:20.517623 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b1b6e491-e727-46df-9942-39fe53820167 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:20.519114 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-b1b6e491-e727-46df-9942-39fe53820167 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1722 microversion: 2.20 time: 0.338873 Jul 15 15:37:20.519693 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 404/814] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:20 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1722 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:21.542113 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8998bc7a-3dfd-419c-8547-c3cc6d0e453d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:21.542729 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8998bc7a-3dfd-419c-8547-c3cc6d0e453d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:21.551018 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8998bc7a-3dfd-419c-8547-c3cc6d0e453d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:21.551459 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8998bc7a-3dfd-419c-8547-c3cc6d0e453d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:21.552228 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8998bc7a-3dfd-419c-8547-c3cc6d0e453d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:21.552651 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8998bc7a-3dfd-419c-8547-c3cc6d0e453d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:21.697978 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8998bc7a-3dfd-419c-8547-c3cc6d0e453d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:21.710553 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8998bc7a-3dfd-419c-8547-c3cc6d0e453d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:21.713034 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8998bc7a-3dfd-419c-8547-c3cc6d0e453d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:21.714940 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8998bc7a-3dfd-419c-8547-c3cc6d0e453d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1722 microversion: 2.20 time: 0.179988 Jul 15 15:37:21.716487 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 411/815] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:21 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:22.082504 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-9f60b446-198b-4a92-9835-78bae3e9deb6 req-acda694b-8f05-42e3-8264-f970f9e4354e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a2a79d6-dd6d-4d59-a58c-11252d834add", "name": "network-vif-unplugged", "status": "completed", "tag": "06b33828-c90f-45fb-839b-8fd1808f8a80"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:37:22.093320 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-9f60b446-198b-4a92-9835-78bae3e9deb6 req-acda694b-8f05-42e3-8264-f970f9e4354e service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:22.093502 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-9f60b446-198b-4a92-9835-78bae3e9deb6 req-acda694b-8f05-42e3-8264-f970f9e4354e service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:22.107969 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-9f60b446-198b-4a92-9835-78bae3e9deb6 req-acda694b-8f05-42e3-8264-f970f9e4354e service nova] Creating event network-vif-unplugged:06b33828-c90f-45fb-839b-8fd1808f8a80 for instance 0a2a79d6-dd6d-4d59-a58c-11252d834add on hv-cinder-85001 Jul 15 15:37:22.114487 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-9f60b446-198b-4a92-9835-78bae3e9deb6 req-acda694b-8f05-42e3-8264-f970f9e4354e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035654 Jul 15 15:37:22.115097 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 405/816] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:37:22.738421 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a4582cf1-7a4f-47db-8b81-d861599513b1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:22.739027 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a4582cf1-7a4f-47db-8b81-d861599513b1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:22.745632 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a4582cf1-7a4f-47db-8b81-d861599513b1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:22.746074 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a4582cf1-7a4f-47db-8b81-d861599513b1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:22.746866 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a4582cf1-7a4f-47db-8b81-d861599513b1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:22.747288 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a4582cf1-7a4f-47db-8b81-d861599513b1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:23.159630 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a4582cf1-7a4f-47db-8b81-d861599513b1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:23.172761 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a4582cf1-7a4f-47db-8b81-d861599513b1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:23.174240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a4582cf1-7a4f-47db-8b81-d861599513b1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:23.175409 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a4582cf1-7a4f-47db-8b81-d861599513b1 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1722 microversion: 2.20 time: 0.441207 Jul 15 15:37:23.175966 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 412/817] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:22 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1722 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:24.195186 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-49e5f15e-6942-4d6e-93a0-60dba8a5a569 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:24.195739 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-49e5f15e-6942-4d6e-93a0-60dba8a5a569 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:24.202899 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-49e5f15e-6942-4d6e-93a0-60dba8a5a569 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:24.203349 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-49e5f15e-6942-4d6e-93a0-60dba8a5a569 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:24.204120 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-49e5f15e-6942-4d6e-93a0-60dba8a5a569 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:24.204540 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-49e5f15e-6942-4d6e-93a0-60dba8a5a569 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:24.354539 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-49e5f15e-6942-4d6e-93a0-60dba8a5a569 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:24.363066 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-49e5f15e-6942-4d6e-93a0-60dba8a5a569 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:24.364567 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-49e5f15e-6942-4d6e-93a0-60dba8a5a569 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:24.365728 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-49e5f15e-6942-4d6e-93a0-60dba8a5a569 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1665 microversion: 2.20 time: 0.175595 Jul 15 15:37:24.366282 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 406/818] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:24 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1665 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:24.384761 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-efcdafee-28ac-44ae-acd2-d31aedc7f3f8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d917c50-83c3-400b-9381-d769bec8aed8"}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:37:24.385815 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-efcdafee-28ac-44ae-acd2-d31aedc7f3f8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:24.394171 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-efcdafee-28ac-44ae-acd2-d31aedc7f3f8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:24.394643 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-efcdafee-28ac-44ae-acd2-d31aedc7f3f8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:24.395502 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-efcdafee-28ac-44ae-acd2-d31aedc7f3f8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:24.396001 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-efcdafee-28ac-44ae-acd2-d31aedc7f3f8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:24.550857 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-9f933d07-f13a-4111-9ffb-7714043167a1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:24.551840 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-9f933d07-f13a-4111-9ffb-7714043167a1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:24.561777 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9f933d07-f13a-4111-9ffb-7714043167a1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:24.562222 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9f933d07-f13a-4111-9ffb-7714043167a1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:24.563578 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9f933d07-f13a-4111-9ffb-7714043167a1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:24.564224 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9f933d07-f13a-4111-9ffb-7714043167a1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:24.611084 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-9f933d07-f13a-4111-9ffb-7714043167a1 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067539 Jul 15 15:37:24.612125 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 407/819] 10.222.0.40 () {58 vars in 1301 bytes} [Fri Jul 15 15:37:24 2022] GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:37:24.627280 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-837d37f6-d78a-41e9-bf85-c8db67acafd6 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:24.628388 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-837d37f6-d78a-41e9-bf85-c8db67acafd6 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:24.637930 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-837d37f6-d78a-41e9-bf85-c8db67acafd6 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:24.638567 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-837d37f6-d78a-41e9-bf85-c8db67acafd6 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:24.639862 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-837d37f6-d78a-41e9-bf85-c8db67acafd6 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:24.640781 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-837d37f6-d78a-41e9-bf85-c8db67acafd6 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:24.677930 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-837d37f6-d78a-41e9-bf85-c8db67acafd6 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592/os-volume_attachments/ccc2a315-697e-4c22-9036-bbd450830e04" status: 200 len: 194 microversion: 2.1 time: 0.057377 Jul 15 15:37:24.678782 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 408/820] 10.222.0.40 () {58 vars in 1412 bytes} [Fri Jul 15 15:37:24 2022] GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592/os-volume_attachments/ccc2a315-697e-4c22-9036-bbd450830e04 => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:37:24.749880 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-efcdafee-28ac-44ae-acd2-d31aedc7f3f8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "POST /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.368939 Jul 15 15:37:24.750996 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 413/821] 10.222.0.40 () {62 vars in 1363 bytes} [Fri Jul 15 15:37:24 2022] POST /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add/os-volume_attachments => generated 188 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 15:37:24.887107 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-58104050-9a45-46fd-b2ed-2d2ee853f6ad tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:24.887954 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-58104050-9a45-46fd-b2ed-2d2ee853f6ad tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:24.895167 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-58104050-9a45-46fd-b2ed-2d2ee853f6ad tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:24.895670 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-58104050-9a45-46fd-b2ed-2d2ee853f6ad tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:24.896524 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-58104050-9a45-46fd-b2ed-2d2ee853f6ad tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:24.897265 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-58104050-9a45-46fd-b2ed-2d2ee853f6ad tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:24.903125 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:25.291042 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-58104050-9a45-46fd-b2ed-2d2ee853f6ad tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add/os-volume_attachments/1d917c50-83c3-400b-9381-d769bec8aed8" status: 202 len: 0 microversion: 2.20 time: 0.409290 Jul 15 15:37:25.291970 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 409/822] 10.222.0.40 () {60 vars in 1456 bytes} [Fri Jul 15 15:37:24 2022] DELETE /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add/os-volume_attachments/1d917c50-83c3-400b-9381-d769bec8aed8 => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:37:25.366111 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-aa1121be-b66b-42c0-9872-014810261132 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:37:25.366703 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-aa1121be-b66b-42c0-9872-014810261132 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:25.373325 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aa1121be-b66b-42c0-9872-014810261132 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:25.373943 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aa1121be-b66b-42c0-9872-014810261132 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:25.374972 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aa1121be-b66b-42c0-9872-014810261132 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:25.375495 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aa1121be-b66b-42c0-9872-014810261132 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:25.474456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:25.490550 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-aa1121be-b66b-42c0-9872-014810261132 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "POST /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add/action" status: 202 len: 0 microversion: 2.20 time: 0.128056 Jul 15 15:37:25.491153 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 414/823] 10.222.0.40 () {62 vars in 1318 bytes} [Fri Jul 15 15:37:25 2022] POST /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:37:25.499457 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-da9c44e3-8602-4eef-886f-d8e1e4f69c0c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:25.500712 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-da9c44e3-8602-4eef-886f-d8e1e4f69c0c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:25.508251 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-da9c44e3-8602-4eef-886f-d8e1e4f69c0c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:25.508613 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-da9c44e3-8602-4eef-886f-d8e1e4f69c0c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:25.509447 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-da9c44e3-8602-4eef-886f-d8e1e4f69c0c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:25.510050 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-da9c44e3-8602-4eef-886f-d8e1e4f69c0c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:25.661520 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-da9c44e3-8602-4eef-886f-d8e1e4f69c0c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:25.671535 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-da9c44e3-8602-4eef-886f-d8e1e4f69c0c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:25.673691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-da9c44e3-8602-4eef-886f-d8e1e4f69c0c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:25.674918 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-da9c44e3-8602-4eef-886f-d8e1e4f69c0c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1673 microversion: 2.20 time: 0.179547 Jul 15 15:37:25.675777 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 410/824] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:25 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1673 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:26.091370 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-08ca18b3-92ec-48ba-91fe-d73619777c8e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eddaff60-b22d-4591-a69c-9174bb36223c"}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:37:26.092596 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-08ca18b3-92ec-48ba-91fe-d73619777c8e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:26.100385 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-08ca18b3-92ec-48ba-91fe-d73619777c8e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:26.100829 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-08ca18b3-92ec-48ba-91fe-d73619777c8e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:26.101660 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-08ca18b3-92ec-48ba-91fe-d73619777c8e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:26.102090 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-08ca18b3-92ec-48ba-91fe-d73619777c8e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:26.378212 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-08ca18b3-92ec-48ba-91fe-d73619777c8e tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "POST /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291977 Jul 15 15:37:26.379113 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 415/825] 10.222.0.40 () {60 vars in 1322 bytes} [Fri Jul 15 15:37:26 2022] POST /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:37:26.696523 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-26426dca-cc89-4c5d-acd9-9c15603379be tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:26.697423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-26426dca-cc89-4c5d-acd9-9c15603379be tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:26.707437 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-26426dca-cc89-4c5d-acd9-9c15603379be tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:26.707878 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-26426dca-cc89-4c5d-acd9-9c15603379be tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:26.708634 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-26426dca-cc89-4c5d-acd9-9c15603379be tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:26.709060 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-26426dca-cc89-4c5d-acd9-9c15603379be tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:26.849122 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-26426dca-cc89-4c5d-acd9-9c15603379be tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:26.857774 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-26426dca-cc89-4c5d-acd9-9c15603379be tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:26.859626 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-26426dca-cc89-4c5d-acd9-9c15603379be tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:26.860834 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-26426dca-cc89-4c5d-acd9-9c15603379be tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1731 microversion: 2.20 time: 0.170411 Jul 15 15:37:26.861425 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 411/826] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:26 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:27.881467 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f4139a79-f610-406a-a88f-067911db42fe tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:27.882240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f4139a79-f610-406a-a88f-067911db42fe tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:27.902432 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f4139a79-f610-406a-a88f-067911db42fe tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:27.902911 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f4139a79-f610-406a-a88f-067911db42fe tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:27.903927 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f4139a79-f610-406a-a88f-067911db42fe tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:27.904355 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f4139a79-f610-406a-a88f-067911db42fe tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:28.149660 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f4139a79-f610-406a-a88f-067911db42fe tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:28.159034 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f4139a79-f610-406a-a88f-067911db42fe tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:28.160959 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f4139a79-f610-406a-a88f-067911db42fe tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:28.162335 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f4139a79-f610-406a-a88f-067911db42fe tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1731 microversion: 2.20 time: 0.285736 Jul 15 15:37:28.163394 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 416/827] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:27 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1731 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:29.182072 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-8375b1a9-fd06-4c92-a061-1be53f99fa79 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:29.182926 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-8375b1a9-fd06-4c92-a061-1be53f99fa79 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:29.190385 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8375b1a9-fd06-4c92-a061-1be53f99fa79 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:29.190841 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8375b1a9-fd06-4c92-a061-1be53f99fa79 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:29.191605 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8375b1a9-fd06-4c92-a061-1be53f99fa79 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:29.192035 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-8375b1a9-fd06-4c92-a061-1be53f99fa79 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:29.346069 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-8375b1a9-fd06-4c92-a061-1be53f99fa79 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:29.354554 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-8375b1a9-fd06-4c92-a061-1be53f99fa79 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:29.356059 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-8375b1a9-fd06-4c92-a061-1be53f99fa79 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:29.357222 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-8375b1a9-fd06-4c92-a061-1be53f99fa79 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1731 microversion: 2.20 time: 0.179435 Jul 15 15:37:29.357788 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 412/828] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:29 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:30.377743 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3699839b-30a4-4a2c-a41b-1ffca8c81666 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:30.378667 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3699839b-30a4-4a2c-a41b-1ffca8c81666 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:30.387013 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3699839b-30a4-4a2c-a41b-1ffca8c81666 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:30.387600 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3699839b-30a4-4a2c-a41b-1ffca8c81666 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:30.388962 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3699839b-30a4-4a2c-a41b-1ffca8c81666 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:30.389461 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3699839b-30a4-4a2c-a41b-1ffca8c81666 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:30.549854 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3699839b-30a4-4a2c-a41b-1ffca8c81666 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:30.558581 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3699839b-30a4-4a2c-a41b-1ffca8c81666 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:30.560542 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3699839b-30a4-4a2c-a41b-1ffca8c81666 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:30.561244 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3699839b-30a4-4a2c-a41b-1ffca8c81666 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1731 microversion: 2.20 time: 0.187837 Jul 15 15:37:30.562015 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 417/829] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:30 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:31.580979 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-dc1f30e3-b161-4ae4-b63f-77227ae1fe10 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:31.581589 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-dc1f30e3-b161-4ae4-b63f-77227ae1fe10 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:31.589323 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-dc1f30e3-b161-4ae4-b63f-77227ae1fe10 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:31.589771 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-dc1f30e3-b161-4ae4-b63f-77227ae1fe10 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:31.590567 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-dc1f30e3-b161-4ae4-b63f-77227ae1fe10 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:31.591024 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-dc1f30e3-b161-4ae4-b63f-77227ae1fe10 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:31.740466 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-dc1f30e3-b161-4ae4-b63f-77227ae1fe10 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:31.752072 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-dc1f30e3-b161-4ae4-b63f-77227ae1fe10 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:31.753916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-dc1f30e3-b161-4ae4-b63f-77227ae1fe10 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:31.755433 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-dc1f30e3-b161-4ae4-b63f-77227ae1fe10 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1731 microversion: 2.20 time: 0.179019 Jul 15 15:37:31.756372 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 413/830] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:31 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:32.786456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5f75622b-1d2d-459c-bc45-7992d0a635d4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:32.791054 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5f75622b-1d2d-459c-bc45-7992d0a635d4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:32.821939 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5f75622b-1d2d-459c-bc45-7992d0a635d4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:32.822398 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5f75622b-1d2d-459c-bc45-7992d0a635d4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:32.823380 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5f75622b-1d2d-459c-bc45-7992d0a635d4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:32.823790 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5f75622b-1d2d-459c-bc45-7992d0a635d4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:33.006492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5f75622b-1d2d-459c-bc45-7992d0a635d4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:33.015205 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5f75622b-1d2d-459c-bc45-7992d0a635d4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:33.016724 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5f75622b-1d2d-459c-bc45-7992d0a635d4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:33.018041 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5f75622b-1d2d-459c-bc45-7992d0a635d4 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1731 microversion: 2.20 time: 0.239440 Jul 15 15:37:33.018620 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 418/831] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:32 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1731 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:34.037152 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-1ee17a34-be9a-44c4-9840-86786d2e0cc9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:34.037908 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-1ee17a34-be9a-44c4-9840-86786d2e0cc9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:34.045186 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1ee17a34-be9a-44c4-9840-86786d2e0cc9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:34.045713 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1ee17a34-be9a-44c4-9840-86786d2e0cc9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:34.046704 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1ee17a34-be9a-44c4-9840-86786d2e0cc9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:34.047194 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1ee17a34-be9a-44c4-9840-86786d2e0cc9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:34.196522 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1ee17a34-be9a-44c4-9840-86786d2e0cc9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:34.206279 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1ee17a34-be9a-44c4-9840-86786d2e0cc9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:34.208025 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1ee17a34-be9a-44c4-9840-86786d2e0cc9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:34.209465 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-1ee17a34-be9a-44c4-9840-86786d2e0cc9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1731 microversion: 2.20 time: 0.176249 Jul 15 15:37:34.212198 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 414/832] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:34 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:35.227513 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9c534024-92ef-42d3-9075-4697eb075367 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:35.228217 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9c534024-92ef-42d3-9075-4697eb075367 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:35.236075 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9c534024-92ef-42d3-9075-4697eb075367 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:35.236547 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9c534024-92ef-42d3-9075-4697eb075367 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:35.237326 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9c534024-92ef-42d3-9075-4697eb075367 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:35.237757 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9c534024-92ef-42d3-9075-4697eb075367 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:35.385791 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9c534024-92ef-42d3-9075-4697eb075367 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:35.394853 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9c534024-92ef-42d3-9075-4697eb075367 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:35.408503 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9c534024-92ef-42d3-9075-4697eb075367 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:35.409981 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9c534024-92ef-42d3-9075-4697eb075367 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1731 microversion: 2.20 time: 0.186350 Jul 15 15:37:35.421118 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 419/833] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:35 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1731 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:36.429193 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-2e9d4c19-a09f-44fe-b919-7615db4aa084 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:36.429860 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-2e9d4c19-a09f-44fe-b919-7615db4aa084 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:36.437881 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c19-a09f-44fe-b919-7615db4aa084 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:36.438326 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c19-a09f-44fe-b919-7615db4aa084 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:36.439140 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c19-a09f-44fe-b919-7615db4aa084 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:36.439573 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c19-a09f-44fe-b919-7615db4aa084 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:36.584221 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-2e9d4c19-a09f-44fe-b919-7615db4aa084 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:36.592473 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-2e9d4c19-a09f-44fe-b919-7615db4aa084 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:36.594046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-2e9d4c19-a09f-44fe-b919-7615db4aa084 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:36.595244 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-2e9d4c19-a09f-44fe-b919-7615db4aa084 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1731 microversion: 2.20 time: 0.170787 Jul 15 15:37:36.595903 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 415/834] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:36 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:37.613908 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ffce8954-d073-4c42-b4ea-7acc9fb2790a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:37.614602 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ffce8954-d073-4c42-b4ea-7acc9fb2790a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:37.622101 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ffce8954-d073-4c42-b4ea-7acc9fb2790a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:37.622774 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ffce8954-d073-4c42-b4ea-7acc9fb2790a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:37.623916 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ffce8954-d073-4c42-b4ea-7acc9fb2790a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:37.624510 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ffce8954-d073-4c42-b4ea-7acc9fb2790a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:37.788510 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ffce8954-d073-4c42-b4ea-7acc9fb2790a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:37.797354 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ffce8954-d073-4c42-b4ea-7acc9fb2790a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:37.798887 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ffce8954-d073-4c42-b4ea-7acc9fb2790a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:37.800184 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ffce8954-d073-4c42-b4ea-7acc9fb2790a tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1731 microversion: 2.20 time: 0.190420 Jul 15 15:37:37.801069 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 420/835] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:37 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1731 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:38.822327 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-e74cb447-33a3-497a-b4ed-a2f745993cae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:38.823625 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-e74cb447-33a3-497a-b4ed-a2f745993cae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:38.833200 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e74cb447-33a3-497a-b4ed-a2f745993cae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:38.833687 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e74cb447-33a3-497a-b4ed-a2f745993cae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:38.834589 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e74cb447-33a3-497a-b4ed-a2f745993cae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:38.835056 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e74cb447-33a3-497a-b4ed-a2f745993cae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:38.974730 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e74cb447-33a3-497a-b4ed-a2f745993cae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:38.983589 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e74cb447-33a3-497a-b4ed-a2f745993cae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:38.985071 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e74cb447-33a3-497a-b4ed-a2f745993cae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:38.986213 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-e74cb447-33a3-497a-b4ed-a2f745993cae tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1731 microversion: 2.20 time: 0.171157 Jul 15 15:37:38.986806 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 416/836] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:38 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:40.005342 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-35831f5c-b20d-4ff0-bc37-e629544e1262 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:40.005928 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-35831f5c-b20d-4ff0-bc37-e629544e1262 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:40.012890 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-35831f5c-b20d-4ff0-bc37-e629544e1262 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:40.013322 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-35831f5c-b20d-4ff0-bc37-e629544e1262 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:40.014065 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-35831f5c-b20d-4ff0-bc37-e629544e1262 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:40.014487 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-35831f5c-b20d-4ff0-bc37-e629544e1262 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:40.158973 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-35831f5c-b20d-4ff0-bc37-e629544e1262 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:40.171992 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-35831f5c-b20d-4ff0-bc37-e629544e1262 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:40.174386 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-35831f5c-b20d-4ff0-bc37-e629544e1262 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:40.176218 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-35831f5c-b20d-4ff0-bc37-e629544e1262 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1731 microversion: 2.20 time: 0.174723 Jul 15 15:37:40.177208 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 421/837] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:40 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:41.198155 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-e5b2f0fa-1dc6-4fc6-96aa-51570a622dc8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:41.199051 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-e5b2f0fa-1dc6-4fc6-96aa-51570a622dc8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:41.208265 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e5b2f0fa-1dc6-4fc6-96aa-51570a622dc8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:41.208966 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e5b2f0fa-1dc6-4fc6-96aa-51570a622dc8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:41.209517 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e5b2f0fa-1dc6-4fc6-96aa-51570a622dc8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:41.209956 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e5b2f0fa-1dc6-4fc6-96aa-51570a622dc8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:41.366024 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e5b2f0fa-1dc6-4fc6-96aa-51570a622dc8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:41.378404 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e5b2f0fa-1dc6-4fc6-96aa-51570a622dc8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:41.381390 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e5b2f0fa-1dc6-4fc6-96aa-51570a622dc8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:41.382709 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-e5b2f0fa-1dc6-4fc6-96aa-51570a622dc8 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1731 microversion: 2.20 time: 0.190808 Jul 15 15:37:41.383564 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 417/838] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:41 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1731 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:42.404423 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b81656e8-a56e-4302-a4d6-33c8201baf5c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:42.405018 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b81656e8-a56e-4302-a4d6-33c8201baf5c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:42.408787 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=44 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:42.413906 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b81656e8-a56e-4302-a4d6-33c8201baf5c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:42.414034 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b81656e8-a56e-4302-a4d6-33c8201baf5c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:42.414776 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b81656e8-a56e-4302-a4d6-33c8201baf5c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:42.415179 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b81656e8-a56e-4302-a4d6-33c8201baf5c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:42.727353 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b81656e8-a56e-4302-a4d6-33c8201baf5c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:42.739913 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b81656e8-a56e-4302-a4d6-33c8201baf5c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:42.741463 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b81656e8-a56e-4302-a4d6-33c8201baf5c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:42.742639 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b81656e8-a56e-4302-a4d6-33c8201baf5c tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1731 microversion: 2.20 time: 0.342474 Jul 15 15:37:42.743199 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 422/839] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:42 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1731 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:43.762093 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-af0b3371-bf77-4461-b1f9-397eeb510c9f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:43.762778 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-af0b3371-bf77-4461-b1f9-397eeb510c9f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:43.769636 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-af0b3371-bf77-4461-b1f9-397eeb510c9f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:43.770099 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-af0b3371-bf77-4461-b1f9-397eeb510c9f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:43.771088 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-af0b3371-bf77-4461-b1f9-397eeb510c9f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:43.771659 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-af0b3371-bf77-4461-b1f9-397eeb510c9f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:43.937945 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-af0b3371-bf77-4461-b1f9-397eeb510c9f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:43.947087 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-af0b3371-bf77-4461-b1f9-397eeb510c9f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:43.948587 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-af0b3371-bf77-4461-b1f9-397eeb510c9f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:43.949761 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-af0b3371-bf77-4461-b1f9-397eeb510c9f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1731 microversion: 2.20 time: 0.191742 Jul 15 15:37:43.950307 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 418/840] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:43 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1731 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:44.636314 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-686086f2-7f68-4e14-9385-c7d3244384f4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:44.637539 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-686086f2-7f68-4e14-9385-c7d3244384f4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:44.645076 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-686086f2-7f68-4e14-9385-c7d3244384f4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:44.645575 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-686086f2-7f68-4e14-9385-c7d3244384f4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:44.646984 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-686086f2-7f68-4e14-9385-c7d3244384f4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:44.647414 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-686086f2-7f68-4e14-9385-c7d3244384f4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:44.680957 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-686086f2-7f68-4e14-9385-c7d3244384f4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049910 Jul 15 15:37:44.681769 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 423/841] 10.222.0.40 () {58 vars in 1301 bytes} [Fri Jul 15 15:37:44 2022] GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:37:44.825129 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-a64815a9-102c-40d0-88a4-8b8eb6739b47 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:44.825738 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-a64815a9-102c-40d0-88a4-8b8eb6739b47 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:44.827976 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=42 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:44.833423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a64815a9-102c-40d0-88a4-8b8eb6739b47 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:44.833960 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a64815a9-102c-40d0-88a4-8b8eb6739b47 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:44.834765 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a64815a9-102c-40d0-88a4-8b8eb6739b47 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:44.835200 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a64815a9-102c-40d0-88a4-8b8eb6739b47 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:44.864411 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-a64815a9-102c-40d0-88a4-8b8eb6739b47 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592/os-volume_attachments/ccc2a315-697e-4c22-9036-bbd450830e04" status: 200 len: 194 microversion: 2.1 time: 0.043625 Jul 15 15:37:44.864949 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 419/842] 10.222.0.40 () {58 vars in 1412 bytes} [Fri Jul 15 15:37:44 2022] GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592/os-volume_attachments/ccc2a315-697e-4c22-9036-bbd450830e04 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:37:44.874824 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-fc5294d4-09f8-4209-b26a-7b6871b91d35 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:44.875309 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-fc5294d4-09f8-4209-b26a-7b6871b91d35 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:44.881662 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fc5294d4-09f8-4209-b26a-7b6871b91d35 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:44.882137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fc5294d4-09f8-4209-b26a-7b6871b91d35 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:44.882931 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fc5294d4-09f8-4209-b26a-7b6871b91d35 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:44.883331 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fc5294d4-09f8-4209-b26a-7b6871b91d35 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:44.967676 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3f3dc77e-4421-44ab-a39e-8016683022d9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:44.968202 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-3f3dc77e-4421-44ab-a39e-8016683022d9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:44.974769 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3f3dc77e-4421-44ab-a39e-8016683022d9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:44.975286 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3f3dc77e-4421-44ab-a39e-8016683022d9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:44.976113 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3f3dc77e-4421-44ab-a39e-8016683022d9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:44.976546 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3f3dc77e-4421-44ab-a39e-8016683022d9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:44.978465 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.objects.instance [None req-fc5294d4-09f8-4209-b26a-7b6871b91d35 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lazy-loading 'services' on Instance uuid d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 {{(pid=117998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:37:45.055898 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-fc5294d4-09f8-4209-b26a-7b6871b91d35 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592/os-volume_attachments/ccc2a315-697e-4c22-9036-bbd450830e04" status: 202 len: 0 microversion: 2.1 time: 0.184851 Jul 15 15:37:45.056500 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 424/843] 10.222.0.40 () {58 vars in 1415 bytes} [Fri Jul 15 15:37:44 2022] DELETE /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592/os-volume_attachments/ccc2a315-697e-4c22-9036-bbd450830e04 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 15:37:45.119200 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3f3dc77e-4421-44ab-a39e-8016683022d9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:45.128272 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3f3dc77e-4421-44ab-a39e-8016683022d9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:45.129774 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3f3dc77e-4421-44ab-a39e-8016683022d9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:45.131223 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-3f3dc77e-4421-44ab-a39e-8016683022d9 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1731 microversion: 2.20 time: 0.167440 Jul 15 15:37:45.131963 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 420/844] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:44 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:46.151837 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1f0a9bbc-b185-4bd6-92f0-6b295c107190 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:46.152531 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1f0a9bbc-b185-4bd6-92f0-6b295c107190 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:46.159657 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1f0a9bbc-b185-4bd6-92f0-6b295c107190 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:46.160152 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1f0a9bbc-b185-4bd6-92f0-6b295c107190 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:46.160989 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1f0a9bbc-b185-4bd6-92f0-6b295c107190 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:46.161496 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1f0a9bbc-b185-4bd6-92f0-6b295c107190 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:46.315761 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1f0a9bbc-b185-4bd6-92f0-6b295c107190 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:46.326974 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1f0a9bbc-b185-4bd6-92f0-6b295c107190 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:46.329144 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1f0a9bbc-b185-4bd6-92f0-6b295c107190 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:46.330816 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1f0a9bbc-b185-4bd6-92f0-6b295c107190 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1731 microversion: 2.20 time: 0.184463 Jul 15 15:37:46.331485 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 425/845] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:46 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:47.255203 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-628e10b6-5721-4eff-bc4b-741b7b4f30c4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:47.255912 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-628e10b6-5721-4eff-bc4b-741b7b4f30c4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:47.264144 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-628e10b6-5721-4eff-bc4b-741b7b4f30c4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:47.264787 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-628e10b6-5721-4eff-bc4b-741b7b4f30c4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:47.265670 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-628e10b6-5721-4eff-bc4b-741b7b4f30c4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:47.266220 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-628e10b6-5721-4eff-bc4b-741b7b4f30c4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:47.302405 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-628e10b6-5721-4eff-bc4b-741b7b4f30c4 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592/os-volume_attachments/eddaff60-b22d-4591-a69c-9174bb36223c" status: 200 len: 194 microversion: 2.1 time: 0.053087 Jul 15 15:37:47.303049 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 421/846] 10.222.0.40 () {58 vars in 1412 bytes} [Fri Jul 15 15:37:47 2022] GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592/os-volume_attachments/eddaff60-b22d-4591-a69c-9174bb36223c => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:37:47.317562 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a8dd7d40-3bb4-4de8-9465-2625a0821af5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:47.318350 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a8dd7d40-3bb4-4de8-9465-2625a0821af5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:47.325002 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a8dd7d40-3bb4-4de8-9465-2625a0821af5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:47.325438 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a8dd7d40-3bb4-4de8-9465-2625a0821af5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:47.326182 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a8dd7d40-3bb4-4de8-9465-2625a0821af5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:47.326702 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a8dd7d40-3bb4-4de8-9465-2625a0821af5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:47.349041 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-39f4579b-dca1-4a5f-9656-45fb9d58a60e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:47.349640 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-39f4579b-dca1-4a5f-9656-45fb9d58a60e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:47.355934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-39f4579b-dca1-4a5f-9656-45fb9d58a60e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:47.356375 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-39f4579b-dca1-4a5f-9656-45fb9d58a60e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:47.357132 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-39f4579b-dca1-4a5f-9656-45fb9d58a60e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:47.358008 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-39f4579b-dca1-4a5f-9656-45fb9d58a60e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:47.407598 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.objects.instance [None req-a8dd7d40-3bb4-4de8-9465-2625a0821af5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lazy-loading 'services' on Instance uuid d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 {{(pid=117998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:37:47.486895 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a8dd7d40-3bb4-4de8-9465-2625a0821af5 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592/os-volume_attachments/eddaff60-b22d-4591-a69c-9174bb36223c" status: 202 len: 0 microversion: 2.1 time: 0.174924 Jul 15 15:37:47.490945 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 426/847] 10.222.0.40 () {58 vars in 1415 bytes} [Fri Jul 15 15:37:47 2022] DELETE /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592/os-volume_attachments/eddaff60-b22d-4591-a69c-9174bb36223c => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:37:47.497960 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-39f4579b-dca1-4a5f-9656-45fb9d58a60e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:47.508899 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-39f4579b-dca1-4a5f-9656-45fb9d58a60e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:47.511231 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-39f4579b-dca1-4a5f-9656-45fb9d58a60e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:47.512619 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-39f4579b-dca1-4a5f-9656-45fb9d58a60e tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1731 microversion: 2.20 time: 0.167311 Jul 15 15:37:47.513653 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 422/848] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:47 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:48.164901 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-3b5a1841-48ad-4b63-9ec3-efbf7a52b5d5 req-c427c1a6-722e-4834-b135-f46c7ba6ed04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a2a79d6-dd6d-4d59-a58c-11252d834add", "name": "network-vif-plugged", "status": "completed", "tag": "06b33828-c90f-45fb-839b-8fd1808f8a80"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:37:48.173265 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-3b5a1841-48ad-4b63-9ec3-efbf7a52b5d5 req-c427c1a6-722e-4834-b135-f46c7ba6ed04 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:48.173657 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-3b5a1841-48ad-4b63-9ec3-efbf7a52b5d5 req-c427c1a6-722e-4834-b135-f46c7ba6ed04 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:48.185513 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-3b5a1841-48ad-4b63-9ec3-efbf7a52b5d5 req-c427c1a6-722e-4834-b135-f46c7ba6ed04 service nova] Creating event network-vif-plugged:06b33828-c90f-45fb-839b-8fd1808f8a80 for instance 0a2a79d6-dd6d-4d59-a58c-11252d834add on hv-cinder-85001 Jul 15 15:37:48.190443 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-3b5a1841-48ad-4b63-9ec3-efbf7a52b5d5 req-c427c1a6-722e-4834-b135-f46c7ba6ed04 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096205 Jul 15 15:37:48.191041 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 427/849] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:37:48.533596 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-1f183ec1-087f-4ef1-84ed-97108f4c750f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:48.534287 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-1f183ec1-087f-4ef1-84ed-97108f4c750f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:48.544086 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1f183ec1-087f-4ef1-84ed-97108f4c750f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:48.544769 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1f183ec1-087f-4ef1-84ed-97108f4c750f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:48.545984 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1f183ec1-087f-4ef1-84ed-97108f4c750f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:48.546726 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1f183ec1-087f-4ef1-84ed-97108f4c750f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:48.564417 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:48.653919 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5497f32e-874d-4104-81db-c46474f9eef8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:48.654949 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5497f32e-874d-4104-81db-c46474f9eef8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:48.661400 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5497f32e-874d-4104-81db-c46474f9eef8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:48.661840 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5497f32e-874d-4104-81db-c46474f9eef8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:48.662647 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5497f32e-874d-4104-81db-c46474f9eef8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:48.663305 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5497f32e-874d-4104-81db-c46474f9eef8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:48.687777 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1f183ec1-087f-4ef1-84ed-97108f4c750f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:48.695424 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5497f32e-874d-4104-81db-c46474f9eef8 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045495 Jul 15 15:37:48.696377 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1f183ec1-087f-4ef1-84ed-97108f4c750f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:48.697866 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1f183ec1-087f-4ef1-84ed-97108f4c750f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:48.698688 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 428/850] 10.222.0.40 () {58 vars in 1301 bytes} [Fri Jul 15 15:37:48 2022] GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 15:37:48.699033 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-1f183ec1-087f-4ef1-84ed-97108f4c750f tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1731 microversion: 2.20 time: 0.170778 Jul 15 15:37:48.699804 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 423/851] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:48 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:48.814686 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-47ecab9b-4d2c-40e9-876d-2bc64e9af12a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:48.816068 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-47ecab9b-4d2c-40e9-876d-2bc64e9af12a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:48.824908 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-47ecab9b-4d2c-40e9-876d-2bc64e9af12a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:48.825393 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-47ecab9b-4d2c-40e9-876d-2bc64e9af12a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:48.826224 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-47ecab9b-4d2c-40e9-876d-2bc64e9af12a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:48.826734 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-47ecab9b-4d2c-40e9-876d-2bc64e9af12a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:48.845360 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:48.860933 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-47ecab9b-4d2c-40e9-876d-2bc64e9af12a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052032 Jul 15 15:37:48.861529 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 429/852] 10.222.0.40 () {58 vars in 1301 bytes} [Fri Jul 15 15:37:48 2022] GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 15:37:48.921015 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-03547a4c-74a6-4a69-acb5-dc721d66f642 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:48.921508 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-03547a4c-74a6-4a69-acb5-dc721d66f642 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:48.930912 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-03547a4c-74a6-4a69-acb5-dc721d66f642 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:48.931431 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-03547a4c-74a6-4a69-acb5-dc721d66f642 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:48.932484 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-03547a4c-74a6-4a69-acb5-dc721d66f642 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:48.933115 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-03547a4c-74a6-4a69-acb5-dc721d66f642 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:48.960852 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-03547a4c-74a6-4a69-acb5-dc721d66f642 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Going to try to terminate instance {{(pid=117999) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 15:37:49.049908 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-03547a4c-74a6-4a69-acb5-dc721d66f642 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592" status: 204 len: 0 microversion: 2.1 time: 0.133097 Jul 15 15:37:49.050492 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 424/853] 10.222.0.40 () {58 vars in 1238 bytes} [Fri Jul 15 15:37:48 2022] DELETE /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:37:49.059519 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-efdb3d1f-30e8-4c2b-8b98-399111ad7098 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:49.060144 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-efdb3d1f-30e8-4c2b-8b98-399111ad7098 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:49.066911 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-efdb3d1f-30e8-4c2b-8b98-399111ad7098 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:49.067317 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-efdb3d1f-30e8-4c2b-8b98-399111ad7098 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:49.068053 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-efdb3d1f-30e8-4c2b-8b98-399111ad7098 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:49.068475 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-efdb3d1f-30e8-4c2b-8b98-399111ad7098 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:49.211732 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-efdb3d1f-30e8-4c2b-8b98-399111ad7098 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:49.220075 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-efdb3d1f-30e8-4c2b-8b98-399111ad7098 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592" status: 200 len: 1672 microversion: 2.1 time: 0.164345 Jul 15 15:37:49.220687 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 430/854] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:37:49 2022] GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:37:49.720583 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-1a4b1518-026d-4ed7-ba1f-ea34c88df82b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:49.721256 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-1a4b1518-026d-4ed7-ba1f-ea34c88df82b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:49.728309 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1a4b1518-026d-4ed7-ba1f-ea34c88df82b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:49.728742 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1a4b1518-026d-4ed7-ba1f-ea34c88df82b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:49.729503 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1a4b1518-026d-4ed7-ba1f-ea34c88df82b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:49.729924 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1a4b1518-026d-4ed7-ba1f-ea34c88df82b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:49.866019 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1a4b1518-026d-4ed7-ba1f-ea34c88df82b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:49.875427 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1a4b1518-026d-4ed7-ba1f-ea34c88df82b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:49.876865 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1a4b1518-026d-4ed7-ba1f-ea34c88df82b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:49.878085 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-1a4b1518-026d-4ed7-ba1f-ea34c88df82b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1731 microversion: 2.20 time: 0.163862 Jul 15 15:37:49.878629 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 425/855] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:49 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:50.240812 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f9dacedf-7e46-48c7-bb86-b986d1e18658 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:50.241643 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f9dacedf-7e46-48c7-bb86-b986d1e18658 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:50.251173 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f9dacedf-7e46-48c7-bb86-b986d1e18658 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:50.251759 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f9dacedf-7e46-48c7-bb86-b986d1e18658 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:50.252840 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f9dacedf-7e46-48c7-bb86-b986d1e18658 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:50.253423 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f9dacedf-7e46-48c7-bb86-b986d1e18658 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:50.395813 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f9dacedf-7e46-48c7-bb86-b986d1e18658 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:50.404006 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f9dacedf-7e46-48c7-bb86-b986d1e18658 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592" status: 200 len: 1672 microversion: 2.1 time: 0.169283 Jul 15 15:37:50.404594 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 431/856] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:37:50 2022] GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 => generated 1672 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:37:50.901953 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-6ea80760-531c-498d-88b3-d89a27609774 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:50.902583 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-6ea80760-531c-498d-88b3-d89a27609774 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:50.910322 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6ea80760-531c-498d-88b3-d89a27609774 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:50.910850 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6ea80760-531c-498d-88b3-d89a27609774 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:50.911631 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6ea80760-531c-498d-88b3-d89a27609774 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:50.912246 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6ea80760-531c-498d-88b3-d89a27609774 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:51.060729 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6ea80760-531c-498d-88b3-d89a27609774 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:51.068957 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6ea80760-531c-498d-88b3-d89a27609774 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:51.071205 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6ea80760-531c-498d-88b3-d89a27609774 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:51.072343 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-6ea80760-531c-498d-88b3-d89a27609774 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1731 microversion: 2.20 time: 0.176662 Jul 15 15:37:51.072944 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 426/857] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:50 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:51.422296 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-008dda86-59ab-4467-921f-015bfcdf9dbd tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:51.422944 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-008dda86-59ab-4467-921f-015bfcdf9dbd tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:51.430074 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-008dda86-59ab-4467-921f-015bfcdf9dbd tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:51.430652 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-008dda86-59ab-4467-921f-015bfcdf9dbd tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:51.431712 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-008dda86-59ab-4467-921f-015bfcdf9dbd tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:51.432144 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-008dda86-59ab-4467-921f-015bfcdf9dbd tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:51.580057 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-008dda86-59ab-4467-921f-015bfcdf9dbd tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:51.588737 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-008dda86-59ab-4467-921f-015bfcdf9dbd tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592" status: 200 len: 1672 microversion: 2.1 time: 0.170396 Jul 15 15:37:51.589384 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 432/858] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:37:51 2022] GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 => generated 1672 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:37:52.091697 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-2ffdab14-55fb-48f4-adf3-3b2112f34418 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:52.092368 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-2ffdab14-55fb-48f4-adf3-3b2112f34418 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:52.099737 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2ffdab14-55fb-48f4-adf3-3b2112f34418 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:52.100188 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2ffdab14-55fb-48f4-adf3-3b2112f34418 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:52.100963 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2ffdab14-55fb-48f4-adf3-3b2112f34418 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:52.101465 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2ffdab14-55fb-48f4-adf3-3b2112f34418 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:52.256692 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-2ffdab14-55fb-48f4-adf3-3b2112f34418 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:52.266085 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-2ffdab14-55fb-48f4-adf3-3b2112f34418 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:52.267831 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-2ffdab14-55fb-48f4-adf3-3b2112f34418 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:52.269045 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-2ffdab14-55fb-48f4-adf3-3b2112f34418 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1731 microversion: 2.20 time: 0.181331 Jul 15 15:37:52.269657 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 427/859] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:52 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:52.605698 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-59a94320-eb29-46b9-a1ff-ef133739d1fb tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:52.606341 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-59a94320-eb29-46b9-a1ff-ef133739d1fb tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:52.613561 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-59a94320-eb29-46b9-a1ff-ef133739d1fb tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:52.613986 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-59a94320-eb29-46b9-a1ff-ef133739d1fb tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:52.614800 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-59a94320-eb29-46b9-a1ff-ef133739d1fb tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:52.615216 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-59a94320-eb29-46b9-a1ff-ef133739d1fb tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:52.880110 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-59a94320-eb29-46b9-a1ff-ef133739d1fb tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08050c1635084492a4b054b172884af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e51044e804442909f18288b9a6430a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:52.888710 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-59a94320-eb29-46b9-a1ff-ef133739d1fb tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592" status: 200 len: 1672 microversion: 2.1 time: 0.287059 Jul 15 15:37:52.889368 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 433/860] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:37:52 2022] GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 => generated 1672 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:37:53.289724 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-43afeff0-ee58-446c-9823-5b86a31d9202 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:53.292073 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-43afeff0-ee58-446c-9823-5b86a31d9202 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:53.298194 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-43afeff0-ee58-446c-9823-5b86a31d9202 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:53.306091 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-43afeff0-ee58-446c-9823-5b86a31d9202 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:53.308517 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-43afeff0-ee58-446c-9823-5b86a31d9202 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:53.309148 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-43afeff0-ee58-446c-9823-5b86a31d9202 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:53.400867 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-01ca1552-3068-44cd-8af8-c7e71608a11e req-e502d4cd-eaea-4db0-959b-105e1ee5a494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b93b8a-ca26-4f4a-8f4a-6ff7769be592", "name": "network-vif-deleted", "tag": "5ae418d2-cd33-40c1-84b3-f759a3b56bd8"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:37:53.422141 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-01ca1552-3068-44cd-8af8-c7e71608a11e req-e502d4cd-eaea-4db0-959b-105e1ee5a494 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:53.422620 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-01ca1552-3068-44cd-8af8-c7e71608a11e req-e502d4cd-eaea-4db0-959b-105e1ee5a494 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:53.474705 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-01ca1552-3068-44cd-8af8-c7e71608a11e req-e502d4cd-eaea-4db0-959b-105e1ee5a494 service nova] Creating event network-vif-deleted:5ae418d2-cd33-40c1-84b3-f759a3b56bd8 for instance d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 on hv-cinder-85001 Jul 15 15:37:53.481181 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-01ca1552-3068-44cd-8af8-c7e71608a11e req-e502d4cd-eaea-4db0-959b-105e1ee5a494 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179339 Jul 15 15:37:53.482845 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 434/861] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:37:53.541176 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-43afeff0-ee58-446c-9823-5b86a31d9202 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:53.552508 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-43afeff0-ee58-446c-9823-5b86a31d9202 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:53.558999 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-43afeff0-ee58-446c-9823-5b86a31d9202 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:37:53.560228 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-43afeff0-ee58-446c-9823-5b86a31d9202 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1718 microversion: 2.20 time: 0.275239 Jul 15 15:37:53.560995 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 428/862] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:37:53 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1718 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:37:53.913721 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5fe98d22-cfc1-4f9f-9dc7-1b4abbb9621b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:53.913721 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5fe98d22-cfc1-4f9f-9dc7-1b4abbb9621b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:53.919039 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5fe98d22-cfc1-4f9f-9dc7-1b4abbb9621b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:53.920608 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5fe98d22-cfc1-4f9f-9dc7-1b4abbb9621b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:53.922738 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5fe98d22-cfc1-4f9f-9dc7-1b4abbb9621b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:53.923411 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5fe98d22-cfc1-4f9f-9dc7-1b4abbb9621b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:53.944129 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-5fe98d22-cfc1-4f9f-9dc7-1b4abbb9621b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] HTTP exception thrown: Instance d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 could not be found. Jul 15 15:37:53.946287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5fe98d22-cfc1-4f9f-9dc7-1b4abbb9621b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Request method failure captured: Jul 15 15:37:53.946287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 HTTP/1.1 Jul 15 15:37:53.946287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:37:53.946287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:37:53.946287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:37:53.946287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 15 15:37:53.946287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:37:53.946287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:37:53.946287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:37:53.946287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:37:53.946287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0Yckp5Reo958jqWzEgIN8s3AU2dJ8n9AMZ4ulj1WZfgX5jzlZ9cFiMcalRcGgcajsHRFQ7WDXDODtWYNqfTYf82aXvcljyf8OGOGPBqc3l_ZRDNfUMvSgy6ai9BX7LcxBLPS4Jepq_tVvIpCR4Mmf1B7FUYtZTBUGt8amEngd3wLfZ0 Jul 15 15:37:53.946287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:37:53.946287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:37:53.946287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:37:53.946287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:37:53.946287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:37:53.946287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:37:53.946287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: 5e51044e804442909f18288b9a6430a5 Jul 15 15:37:53.946287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-AttachVolumeTestJSON-1197345005 Jul 15 15:37:53.946287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:37:53.946287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:37:53.949214 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5e51044e804442909f18288b9a6430a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5e51044e804442909f18288b9a6430a5", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5e51044e804442909f18288b9a6430a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5e51044e804442909f18288b9a6430a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:37:53.949214 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-AttachVolumeTestJSON-1197345005 Jul 15 15:37:53.949214 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 5e51044e804442909f18288b9a6430a5 Jul 15 15:37:53.949214 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1197345005 Jul 15 15:37:53.949214 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-AttachVolumeTestJSON-1197345005-project Jul 15 15:37:53.949214 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:37:53.949214 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:37:53.949214 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: 08050c1635084492a4b054b172884af8 Jul 15 15:37:53.949214 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-AttachVolumeTestJSON-1197345005-project Jul 15 15:37:53.949214 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: > Jul 15 15:37:53.949214 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Instance d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 could not be found. Jul 15 15:37:53.949214 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'id': 'd2b93b8a-ca26-4f4a-8f4a-6ff7769be592'} Jul 15 15:37:53.951765 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:37:53.951765 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:37:53.951765 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:37:53.951765 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:37:53.951765 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:37:53.951765 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:37:53.951765 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:37:53.951765 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:37:53.951765 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:37:53.951765 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:37:53.951765 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 could not be found. Jul 15 15:37:53.951765 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:37:53.951765 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:37:53.951765 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:37:53.951765 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:37:53.951765 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:37:53.951765 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:37:53.951765 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:37:53.951765 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:37:53.951765 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:37:53.954457 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:37:53.954457 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:37:53.954457 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:37:53.954457 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:37:53.954457 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:37:53.954457 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:37:53.954457 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:37:53.954457 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 could not be found. Jul 15 15:37:53.954457 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:37:53.954457 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:37:53.954457 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:37:53.954457 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:37:53.954457 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:37:53.954457 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:37:53.954457 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:37:53.954457 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:37:53.954457 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 could not be found. Jul 15 15:37:53.954457 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:37:53.956893 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5fe98d22-cfc1-4f9f-9dc7-1b4abbb9621b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Returning 404 to user: Instance d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:37:53.956893 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5fe98d22-cfc1-4f9f-9dc7-1b4abbb9621b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592" status: 404 len: 111 microversion: 2.1 time: 0.044754 Jul 15 15:37:53.956893 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 435/863] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:37:53 2022] GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:37:53.963118 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-f99d27d3-1c0d-4371-9b88-ef54c212b95b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '.version_select at 0x7fe3c6705a60>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:53.998149 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-f99d27d3-1c0d-4371-9b88-ef54c212b95b tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-529074848" status: 202 len: 0 microversion: 2.1 time: 0.041024 Jul 15 15:37:53.999286 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 429/864] 10.222.0.40 () {58 vars in 1217 bytes} [Fri Jul 15 15:37:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-529074848 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:37:57.089848 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0d24e989-6aca-485d-ad09-608378904e7d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:57.090438 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-0d24e989-6aca-485d-ad09-608378904e7d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:57.097837 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0d24e989-6aca-485d-ad09-608378904e7d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:57.098283 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0d24e989-6aca-485d-ad09-608378904e7d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:57.099501 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0d24e989-6aca-485d-ad09-608378904e7d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:57.099501 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0d24e989-6aca-485d-ad09-608378904e7d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:57.114460 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-0d24e989-6aca-485d-ad09-608378904e7d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] HTTP exception thrown: Instance d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 could not be found. Jul 15 15:37:57.116041 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0d24e989-6aca-485d-ad09-608378904e7d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Request method failure captured: Jul 15 15:37:57.116041 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: DELETE /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 HTTP/1.1 Jul 15 15:37:57.116041 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:37:57.116041 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:37:57.116041 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:37:57.116041 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 15 15:37:57.116041 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:37:57.116041 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:37:57.116041 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:37:57.116041 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:37:57.116041 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0Yckp5Reo958jqWzEgIN8s3AU2dJ8n9AMZ4ulj1WZfgX5jzlZ9cFiMcalRcGgcajsHRFQ7WDXDODtWYNqfTYf82aXvcljyf8OGOGPBqc3l_ZRDNfUMvSgy6ai9BX7LcxBLPS4Jepq_tVvIpCR4Mmf1B7FUYtZTBUGt8amEngd3wLfZ0 Jul 15 15:37:57.116041 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:37:57.116041 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:37:57.116041 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:37:57.116041 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:37:57.116041 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:37:57.116041 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:37:57.116041 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: 5e51044e804442909f18288b9a6430a5 Jul 15 15:37:57.116041 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-AttachVolumeTestJSON-1197345005 Jul 15 15:37:57.116041 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:37:57.116041 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:37:57.118464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5e51044e804442909f18288b9a6430a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5e51044e804442909f18288b9a6430a5", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5e51044e804442909f18288b9a6430a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5e51044e804442909f18288b9a6430a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:37:57.118464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-AttachVolumeTestJSON-1197345005 Jul 15 15:37:57.118464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 5e51044e804442909f18288b9a6430a5 Jul 15 15:37:57.118464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1197345005 Jul 15 15:37:57.118464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-AttachVolumeTestJSON-1197345005-project Jul 15 15:37:57.118464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:37:57.118464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:37:57.118464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: 08050c1635084492a4b054b172884af8 Jul 15 15:37:57.118464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-AttachVolumeTestJSON-1197345005-project Jul 15 15:37:57.118464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: > Jul 15 15:37:57.118464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Instance d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 could not be found. Jul 15 15:37:57.118464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'id': 'd2b93b8a-ca26-4f4a-8f4a-6ff7769be592'} Jul 15 15:37:57.119925 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:37:57.119925 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:37:57.119925 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:37:57.119925 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:37:57.119925 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:37:57.119925 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:37:57.119925 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:37:57.119925 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:37:57.119925 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:37:57.119925 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:37:57.119925 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 could not be found. Jul 15 15:37:57.119925 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:37:57.119925 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:37:57.119925 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:37:57.119925 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:37:57.119925 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:37:57.119925 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:37:57.119925 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:37:57.119925 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:37:57.119925 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:37:57.122240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:37:57.122240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 15:37:57.122240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 15:37:57.122240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 15:37:57.122240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 15:37:57.122240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:37:57.122240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:37:57.122240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:37:57.122240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:37:57.122240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 could not be found. Jul 15 15:37:57.122240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:37:57.122240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:37:57.122240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:37:57.122240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:37:57.122240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:37:57.122240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:37:57.122240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:37:57.122240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:37:57.122240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 could not be found. Jul 15 15:37:57.122240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:37:57.125224 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0d24e989-6aca-485d-ad09-608378904e7d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Returning 404 to user: Instance d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:37:57.125224 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-0d24e989-6aca-485d-ad09-608378904e7d tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592" status: 404 len: 111 microversion: 2.1 time: 0.031740 Jul 15 15:37:57.125224 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 436/865] 10.222.0.40 () {58 vars in 1238 bytes} [Fri Jul 15 15:37:57 2022] DELETE /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:37:57.131539 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-053c5885-e0b0-4728-946e-0102cd566d7a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:57.132228 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-053c5885-e0b0-4728-946e-0102cd566d7a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d2b93b8a-ca26-4f4a-8f4a-6ff7769be592] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:57.139877 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-053c5885-e0b0-4728-946e-0102cd566d7a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:57.140453 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-053c5885-e0b0-4728-946e-0102cd566d7a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:57.141391 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-053c5885-e0b0-4728-946e-0102cd566d7a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:57.141909 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-053c5885-e0b0-4728-946e-0102cd566d7a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:57.155656 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.wsgi [None req-053c5885-e0b0-4728-946e-0102cd566d7a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] HTTP exception thrown: Instance d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 could not be found. Jul 15 15:37:57.157310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-053c5885-e0b0-4728-946e-0102cd566d7a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Request method failure captured: Jul 15 15:37:57.157310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: request: GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 HTTP/1.1 Jul 15 15:37:57.157310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept: application/json Jul 15 15:37:57.157310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept-Encoding: identity Jul 15 15:37:57.157310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Connection: close Jul 15 15:37:57.157310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Length: 0 Jul 15 15:37:57.157310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Type: application/json Jul 15 15:37:57.157310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Host: 10.222.0.40 Jul 15 15:37:57.157310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Openstack-System-Scope: None Jul 15 15:37:57.157310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: User-Agent: python-urllib3/1.26.9 Jul 15 15:37:57.157310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Auth-Token: gAAAAABi0Yckp5Reo958jqWzEgIN8s3AU2dJ8n9AMZ4ulj1WZfgX5jzlZ9cFiMcalRcGgcajsHRFQ7WDXDODtWYNqfTYf82aXvcljyf8OGOGPBqc3l_ZRDNfUMvSgy6ai9BX7LcxBLPS4Jepq_tVvIpCR4Mmf1B7FUYtZTBUGt8amEngd3wLfZ0 Jul 15 15:37:57.157310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Id: None Jul 15 15:37:57.157310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Name: None Jul 15 15:37:57.157310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Identity-Status: Confirmed Jul 15 15:37:57.157310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Is-Admin-Project: True Jul 15 15:37:57.157310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Id: default Jul 15 15:37:57.157310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Name: Default Jul 15 15:37:57.157310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Id: 5e51044e804442909f18288b9a6430a5 Jul 15 15:37:57.157310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Name: tempest-AttachVolumeTestJSON-1197345005 Jul 15 15:37:57.157310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Role: member,reader Jul 15 15:37:57.157310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Roles: member,reader Jul 15 15:37:57.159423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5e51044e804442909f18288b9a6430a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5e51044e804442909f18288b9a6430a5", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5e51044e804442909f18288b9a6430a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5e51044e804442909f18288b9a6430a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:37:57.159423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant: tempest-AttachVolumeTestJSON-1197345005 Jul 15 15:37:57.159423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Id: 5e51044e804442909f18288b9a6430a5 Jul 15 15:37:57.159423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1197345005 Jul 15 15:37:57.159423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User: tempest-AttachVolumeTestJSON-1197345005-project Jul 15 15:37:57.159423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Id: default Jul 15 15:37:57.159423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Name: Default Jul 15 15:37:57.159423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Id: 08050c1635084492a4b054b172884af8 Jul 15 15:37:57.159423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Name: tempest-AttachVolumeTestJSON-1197345005-project Jul 15 15:37:57.159423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: method: > Jul 15 15:37:57.159423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: exception: Instance d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 could not be found. Jul 15 15:37:57.159423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: action_args: {'id': 'd2b93b8a-ca26-4f4a-8f4a-6ff7769be592'} Jul 15 15:37:57.160452 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:37:57.160452 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:37:57.160452 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:37:57.160452 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:37:57.160452 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:37:57.160452 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:37:57.160452 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:37:57.160452 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:37:57.160452 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:37:57.160452 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:37:57.160452 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 could not be found. Jul 15 15:37:57.160452 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:37:57.160452 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:37:57.160452 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:37:57.160452 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:37:57.160452 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:37:57.160452 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:37:57.160452 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:37:57.160452 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:37:57.160452 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:37:57.162336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:37:57.162336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:37:57.162336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:37:57.162336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:37:57.162336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:37:57.162336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:37:57.162336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:37:57.162336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 could not be found. Jul 15 15:37:57.162336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:37:57.162336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:37:57.162336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:37:57.162336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:37:57.162336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:37:57.162336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:37:57.162336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:37:57.162336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:37:57.162336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 could not be found. Jul 15 15:37:57.162336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:37:57.164579 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-053c5885-e0b0-4728-946e-0102cd566d7a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Returning 404 to user: Instance d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 could not be found. {{(pid=117999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:37:57.164579 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-053c5885-e0b0-4728-946e-0102cd566d7a tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592" status: 404 len: 111 microversion: 2.1 time: 0.031581 Jul 15 15:37:57.164579 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 430/866] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:37:57 2022] GET /compute/v2.1/servers/d2b93b8a-ca26-4f4a-8f4a-6ff7769be592 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:37:58.325139 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-26879462-d9ef-467a-9af6-e2deb8b743b7 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:58.325694 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-26879462-d9ef-467a-9af6-e2deb8b743b7 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:58.332584 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-26879462-d9ef-467a-9af6-e2deb8b743b7 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:58.333022 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-26879462-d9ef-467a-9af6-e2deb8b743b7 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:58.333774 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-26879462-d9ef-467a-9af6-e2deb8b743b7 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:58.334194 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-26879462-d9ef-467a-9af6-e2deb8b743b7 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:58.348793 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-26879462-d9ef-467a-9af6-e2deb8b743b7 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] HTTP exception thrown: Instance d95c0294-3423-429b-8bcf-43e2089fca23 could not be found. Jul 15 15:37:58.349782 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-26879462-d9ef-467a-9af6-e2deb8b743b7 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Request method failure captured: Jul 15 15:37:58.349782 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: DELETE /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 HTTP/1.1 Jul 15 15:37:58.349782 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:37:58.349782 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:37:58.349782 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:37:58.349782 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 15 15:37:58.349782 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:37:58.349782 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:37:58.349782 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:37:58.349782 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:37:58.349782 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0Yckp5Reo958jqWzEgIN8s3AU2dJ8n9AMZ4ulj1WZfgX5jzlZ9cFiMcalRcGgcajsHRFQ7WDXDODtWYNqfTYf82aXvcljyf8OGOGPBqc3l_ZRDNfUMvSgy6ai9BX7LcxBLPS4Jepq_tVvIpCR4Mmf1B7FUYtZTBUGt8amEngd3wLfZ0 Jul 15 15:37:58.349782 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:37:58.349782 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:37:58.349782 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:37:58.349782 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:37:58.349782 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:37:58.349782 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:37:58.349782 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: 5e51044e804442909f18288b9a6430a5 Jul 15 15:37:58.349782 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-AttachVolumeTestJSON-1197345005 Jul 15 15:37:58.349782 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:37:58.349782 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:37:58.351961 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5e51044e804442909f18288b9a6430a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5e51044e804442909f18288b9a6430a5", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5e51044e804442909f18288b9a6430a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5e51044e804442909f18288b9a6430a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:37:58.351961 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-AttachVolumeTestJSON-1197345005 Jul 15 15:37:58.351961 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 5e51044e804442909f18288b9a6430a5 Jul 15 15:37:58.351961 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1197345005 Jul 15 15:37:58.351961 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-AttachVolumeTestJSON-1197345005-project Jul 15 15:37:58.351961 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:37:58.351961 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:37:58.351961 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: 08050c1635084492a4b054b172884af8 Jul 15 15:37:58.351961 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-AttachVolumeTestJSON-1197345005-project Jul 15 15:37:58.351961 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: > Jul 15 15:37:58.351961 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Instance d95c0294-3423-429b-8bcf-43e2089fca23 could not be found. Jul 15 15:37:58.351961 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'id': 'd95c0294-3423-429b-8bcf-43e2089fca23'} Jul 15 15:37:58.353851 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:37:58.353851 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:37:58.353851 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:37:58.353851 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:37:58.353851 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:37:58.353851 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:37:58.353851 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:37:58.353851 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:37:58.353851 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:37:58.353851 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:37:58.353851 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d95c0294-3423-429b-8bcf-43e2089fca23 could not be found. Jul 15 15:37:58.353851 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:37:58.353851 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:37:58.353851 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:37:58.353851 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:37:58.353851 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:37:58.353851 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:37:58.353851 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:37:58.353851 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:37:58.353851 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:37:58.356518 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:37:58.356518 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 15:37:58.356518 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 15:37:58.356518 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 15:37:58.356518 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 15:37:58.356518 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:37:58.356518 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:37:58.356518 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:37:58.356518 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:37:58.356518 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d95c0294-3423-429b-8bcf-43e2089fca23 could not be found. Jul 15 15:37:58.356518 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:37:58.356518 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:37:58.356518 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:37:58.356518 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:37:58.356518 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:37:58.356518 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:37:58.356518 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:37:58.356518 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:37:58.356518 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d95c0294-3423-429b-8bcf-43e2089fca23 could not be found. Jul 15 15:37:58.356518 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:37:58.359220 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-26879462-d9ef-467a-9af6-e2deb8b743b7 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Returning 404 to user: Instance d95c0294-3423-429b-8bcf-43e2089fca23 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:37:58.359220 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-26879462-d9ef-467a-9af6-e2deb8b743b7 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 404 len: 111 microversion: 2.1 time: 0.030020 Jul 15 15:37:58.359220 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 437/867] 10.222.0.40 () {58 vars in 1238 bytes} [Fri Jul 15 15:37:58 2022] DELETE /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:37:58.362993 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-d27c2ac1-cc7b-493b-b9d0-a8003518bb37 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:37:58.363595 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-d27c2ac1-cc7b-493b-b9d0-a8003518bb37 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] [instance: d95c0294-3423-429b-8bcf-43e2089fca23] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:37:58.371201 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d27c2ac1-cc7b-493b-b9d0-a8003518bb37 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:58.371645 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d27c2ac1-cc7b-493b-b9d0-a8003518bb37 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:58.372408 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d27c2ac1-cc7b-493b-b9d0-a8003518bb37 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:37:58.372837 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d27c2ac1-cc7b-493b-b9d0-a8003518bb37 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:37:58.386925 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.wsgi [None req-d27c2ac1-cc7b-493b-b9d0-a8003518bb37 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] HTTP exception thrown: Instance d95c0294-3423-429b-8bcf-43e2089fca23 could not be found. Jul 15 15:37:58.388443 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-d27c2ac1-cc7b-493b-b9d0-a8003518bb37 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Request method failure captured: Jul 15 15:37:58.388443 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: request: GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 HTTP/1.1 Jul 15 15:37:58.388443 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept: application/json Jul 15 15:37:58.388443 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept-Encoding: identity Jul 15 15:37:58.388443 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Connection: close Jul 15 15:37:58.388443 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Length: 0 Jul 15 15:37:58.388443 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Type: application/json Jul 15 15:37:58.388443 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Host: 10.222.0.40 Jul 15 15:37:58.388443 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Openstack-System-Scope: None Jul 15 15:37:58.388443 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: User-Agent: python-urllib3/1.26.9 Jul 15 15:37:58.388443 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Auth-Token: gAAAAABi0Yckp5Reo958jqWzEgIN8s3AU2dJ8n9AMZ4ulj1WZfgX5jzlZ9cFiMcalRcGgcajsHRFQ7WDXDODtWYNqfTYf82aXvcljyf8OGOGPBqc3l_ZRDNfUMvSgy6ai9BX7LcxBLPS4Jepq_tVvIpCR4Mmf1B7FUYtZTBUGt8amEngd3wLfZ0 Jul 15 15:37:58.388443 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Id: None Jul 15 15:37:58.388443 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Name: None Jul 15 15:37:58.388443 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Identity-Status: Confirmed Jul 15 15:37:58.388443 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Is-Admin-Project: True Jul 15 15:37:58.388443 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Id: default Jul 15 15:37:58.388443 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Name: Default Jul 15 15:37:58.388443 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Id: 5e51044e804442909f18288b9a6430a5 Jul 15 15:37:58.388443 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Name: tempest-AttachVolumeTestJSON-1197345005 Jul 15 15:37:58.388443 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Role: member,reader Jul 15 15:37:58.388443 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Roles: member,reader Jul 15 15:37:58.390846 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5e51044e804442909f18288b9a6430a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5e51044e804442909f18288b9a6430a5", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5e51044e804442909f18288b9a6430a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5e51044e804442909f18288b9a6430a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:37:58.390846 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant: tempest-AttachVolumeTestJSON-1197345005 Jul 15 15:37:58.390846 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Id: 5e51044e804442909f18288b9a6430a5 Jul 15 15:37:58.390846 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1197345005 Jul 15 15:37:58.390846 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User: tempest-AttachVolumeTestJSON-1197345005-project Jul 15 15:37:58.390846 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Id: default Jul 15 15:37:58.390846 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Name: Default Jul 15 15:37:58.390846 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Id: 08050c1635084492a4b054b172884af8 Jul 15 15:37:58.390846 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Name: tempest-AttachVolumeTestJSON-1197345005-project Jul 15 15:37:58.390846 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: method: > Jul 15 15:37:58.390846 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: exception: Instance d95c0294-3423-429b-8bcf-43e2089fca23 could not be found. Jul 15 15:37:58.390846 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: action_args: {'id': 'd95c0294-3423-429b-8bcf-43e2089fca23'} Jul 15 15:37:58.392160 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:37:58.392160 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:37:58.392160 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:37:58.392160 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:37:58.392160 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:37:58.392160 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:37:58.392160 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:37:58.392160 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:37:58.392160 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:37:58.392160 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:37:58.392160 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d95c0294-3423-429b-8bcf-43e2089fca23 could not be found. Jul 15 15:37:58.392160 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:37:58.392160 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:37:58.392160 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:37:58.392160 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:37:58.392160 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:37:58.392160 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:37:58.392160 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:37:58.392160 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:37:58.392160 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:37:58.394650 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:37:58.394650 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:37:58.394650 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:37:58.394650 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:37:58.394650 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:37:58.394650 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:37:58.394650 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:37:58.394650 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d95c0294-3423-429b-8bcf-43e2089fca23 could not be found. Jul 15 15:37:58.394650 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:37:58.394650 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:37:58.394650 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:37:58.394650 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:37:58.394650 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:37:58.394650 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:37:58.394650 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:37:58.394650 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:37:58.394650 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d95c0294-3423-429b-8bcf-43e2089fca23 could not be found. Jul 15 15:37:58.394650 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:37:58.397153 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-d27c2ac1-cc7b-493b-b9d0-a8003518bb37 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] Returning 404 to user: Instance d95c0294-3423-429b-8bcf-43e2089fca23 could not be found. {{(pid=117999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:37:58.397153 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-d27c2ac1-cc7b-493b-b9d0-a8003518bb37 tempest-AttachVolumeTestJSON-1197345005 tempest-AttachVolumeTestJSON-1197345005-project] 10.222.0.40 "GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23" status: 404 len: 111 microversion: 2.1 time: 0.031417 Jul 15 15:37:58.397153 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 431/868] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:37:58 2022] GET /compute/v2.1/servers/d95c0294-3423-429b-8bcf-43e2089fca23 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:38:04.800951 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e36a9288-52bf-4ae9-83a6-6aa5095db0b6 tempest-VolumesTestJSON-311988335 tempest-VolumesTestJSON-311988335-project] Calling method '.version_select at 0x7fe3c663e280>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:38:04.874906 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e36a9288-52bf-4ae9-83a6-6aa5095db0b6 tempest-VolumesTestJSON-311988335 tempest-VolumesTestJSON-311988335-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/0c7874f7-0bed-4e6e-984c-5c613966c497" status: 200 len: 349 microversion: 2.1 time: 0.077769 Jul 15 15:38:04.875471 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 438/869] 10.222.0.40 () {58 vars in 1244 bytes} [Fri Jul 15 15:38:04 2022] GET /compute/v2.1/os-volumes/0c7874f7-0bed-4e6e-984c-5c613966c497 => generated 349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:38:06.278273 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-e47fb8cd-df31-40ab-b034-0f7c75e2aaa2 tempest-VolumesTestJSON-311988335 tempest-VolumesTestJSON-311988335-project] Calling method '.version_select at 0x7fe3c66fa550>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:38:06.341747 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-e47fb8cd-df31-40ab-b034-0f7c75e2aaa2 tempest-VolumesTestJSON-311988335 tempest-VolumesTestJSON-311988335-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/3a3a98f0-02d4-4918-8040-3d17dbcf847f" status: 200 len: 351 microversion: 2.1 time: 0.067238 Jul 15 15:38:06.342448 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 432/870] 10.222.0.40 () {58 vars in 1244 bytes} [Fri Jul 15 15:38:06 2022] GET /compute/v2.1/os-volumes/3a3a98f0-02d4-4918-8040-3d17dbcf847f => generated 351 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:38:08.758123 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=31 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:38:08.758880 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=34 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:38:08.762775 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-21d51a03-c8e7-4745-a665-2c5ef4700b81 tempest-VolumesTestJSON-311988335 tempest-VolumesTestJSON-311988335-project] Calling method '.version_select at 0x7fe3c6671b80>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:38:08.821268 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-21d51a03-c8e7-4745-a665-2c5ef4700b81 tempest-VolumesTestJSON-311988335 tempest-VolumesTestJSON-311988335-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/9e675e13-6f0c-4255-b320-c682d886d833" status: 200 len: 350 microversion: 2.1 time: 0.065512 Jul 15 15:38:08.821827 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 439/871] 10.222.0.40 () {58 vars in 1244 bytes} [Fri Jul 15 15:38:08 2022] GET /compute/v2.1/os-volumes/9e675e13-6f0c-4255-b320-c682d886d833 => generated 350 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:38:08.831993 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:38:08.833233 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:38:08.842105 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-31c6c539-8711-41bd-94ea-0a45575ea618 tempest-VolumesTestJSON-311988335 tempest-VolumesTestJSON-311988335-project] Calling method '.version_select at 0x7fe3c67873a0>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:38:08.931811 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-31c6c539-8711-41bd-94ea-0a45575ea618 tempest-VolumesTestJSON-311988335 tempest-VolumesTestJSON-311988335-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.101772 Jul 15 15:38:08.932380 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 433/872] 10.222.0.40 () {58 vars in 1133 bytes} [Fri Jul 15 15:38:08 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:38:08.945350 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1eb825fd-23b3-4986-8792-d4c809652a60 tempest-VolumesTestJSON-311988335 tempest-VolumesTestJSON-311988335-project] Calling method '.version_select at 0x7fe3c67909d0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:38:09.029507 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1eb825fd-23b3-4986-8792-d4c809652a60 tempest-VolumesTestJSON-311988335 tempest-VolumesTestJSON-311988335-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087986 Jul 15 15:38:09.030078 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 440/873] 10.222.0.40 () {58 vars in 1148 bytes} [Fri Jul 15 15:38:08 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:38:09.042146 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-4207e8c1-2f0f-4047-8591-fdb2b83de9cc tempest-VolumesTestJSON-311988335 tempest-VolumesTestJSON-311988335-project] Calling method '.version_select at 0x7fe3c66fad30>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:38:09.129113 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-4207e8c1-2f0f-4047-8591-fdb2b83de9cc tempest-VolumesTestJSON-311988335 tempest-VolumesTestJSON-311988335-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.090754 Jul 15 15:38:09.129700 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 434/874] 10.222.0.40 () {58 vars in 1133 bytes} [Fri Jul 15 15:38:09 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:38:09.141868 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-18baa008-5c6f-4493-b10f-25acf4850663 tempest-VolumesTestJSON-311988335 tempest-VolumesTestJSON-311988335-project] Calling method '.version_select at 0x7fe3c671cca0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:38:09.226060 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-18baa008-5c6f-4493-b10f-25acf4850663 tempest-VolumesTestJSON-311988335 tempest-VolumesTestJSON-311988335-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088517 Jul 15 15:38:09.226898 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 441/875] 10.222.0.40 () {58 vars in 1166 bytes} [Fri Jul 15 15:38:09 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:38:09.242304 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-e3ec128c-f50c-419e-bfe5-cd868bc555f4 tempest-VolumesTestJSON-311988335 tempest-VolumesTestJSON-311988335-project] Calling method '.version_select at 0x7fe3c6705ee0>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:38:09.330358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-e3ec128c-f50c-419e-bfe5-cd868bc555f4 tempest-VolumesTestJSON-311988335 tempest-VolumesTestJSON-311988335-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.094646 Jul 15 15:38:09.331007 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 435/876] 10.222.0.40 () {58 vars in 1169 bytes} [Fri Jul 15 15:38:09 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:38:09.343528 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-fbdd6c43-0c7c-4c4c-a7aa-312e2dad83c5 tempest-VolumesTestJSON-311988335 tempest-VolumesTestJSON-311988335-project] Calling method '.version_select at 0x7fe3c6671790>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:38:09.439695 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-fbdd6c43-0c7c-4c4c-a7aa-312e2dad83c5 tempest-VolumesTestJSON-311988335 tempest-VolumesTestJSON-311988335-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.100090 Jul 15 15:38:09.440250 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 442/877] 10.222.0.40 () {58 vars in 1154 bytes} [Fri Jul 15 15:38:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:38:09.451811 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3cedf8e4-f787-486c-b0e2-31d49ab7444e tempest-VolumesTestJSON-311988335 tempest-VolumesTestJSON-311988335-project] Calling method '.version_select at 0x7fe3c6787820>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:38:09.541830 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-3cedf8e4-f787-486c-b0e2-31d49ab7444e tempest-VolumesTestJSON-311988335 tempest-VolumesTestJSON-311988335-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.093933 Jul 15 15:38:09.542396 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 436/878] 10.222.0.40 () {58 vars in 1187 bytes} [Fri Jul 15 15:38:09 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:38:09.557376 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-178ef0c8-a6b4-46dd-bf6a-d807b769d1d1 tempest-VolumesTestJSON-311988335 tempest-VolumesTestJSON-311988335-project] Calling method '.version_select at 0x7fe3c6671ca0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:38:09.642237 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-178ef0c8-a6b4-46dd-bf6a-d807b769d1d1 tempest-VolumesTestJSON-311988335 tempest-VolumesTestJSON-311988335-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.090876 Jul 15 15:38:09.643030 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 443/879] 10.222.0.40 () {58 vars in 1154 bytes} [Fri Jul 15 15:38:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:38:09.746496 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 15:38:09.748140 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Fri Jul 15 15:38:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 15:38:14.891697 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-ec952f85-b3db-4a08-96db-158120bf7e63 tempest-VolumesNegativeTest-1624254314 tempest-VolumesNegativeTest-1624254314-project] Action: 'create', calling method: .version_select at 0x7fe3c6753160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-211360901", "metadata": {"Type": "work"}}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:38:14.909548 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-ec952f85-b3db-4a08-96db-158120bf7e63 tempest-VolumesNegativeTest-1624254314 tempest-VolumesNegativeTest-1624254314-project] Request method failure captured: Jul 15 15:38:14.909548 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 15 15:38:14.909548 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept: application/json Jul 15 15:38:14.909548 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept-Encoding: identity Jul 15 15:38:14.909548 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Connection: close Jul 15 15:38:14.909548 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Length: 121 Jul 15 15:38:14.909548 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Type: application/json Jul 15 15:38:14.909548 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Host: 10.222.0.40 Jul 15 15:38:14.909548 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Openstack-System-Scope: None Jul 15 15:38:14.909548 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: User-Agent: python-urllib3/1.26.9 Jul 15 15:38:14.909548 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Auth-Token: gAAAAABi0YnmV6eArTLzMjy93qL4tto4MrBy21KOIp7WmsdApSpNleQGJHRlsBE70oaJGhyrNABxVyRh2uBv4zjvlMd3pC0WGUgNVuXlSijeiw-Wve-cW7q19-My3WH1K6_fd6HCrBzOl70bt9omRs18cBx0pixYF1W9HRD18bvkmItBT5JqBoo Jul 15 15:38:14.909548 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Id: None Jul 15 15:38:14.909548 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Name: None Jul 15 15:38:14.909548 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Identity-Status: Confirmed Jul 15 15:38:14.909548 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Is-Admin-Project: True Jul 15 15:38:14.909548 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Id: default Jul 15 15:38:14.909548 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Name: Default Jul 15 15:38:14.909548 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Id: c1daf9239aeb40c4a61a14de527dc954 Jul 15 15:38:14.909548 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Name: tempest-VolumesNegativeTest-1624254314 Jul 15 15:38:14.909548 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Role: member,reader Jul 15 15:38:14.909548 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Roles: member,reader Jul 15 15:38:14.911250 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c1daf9239aeb40c4a61a14de527dc954"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c1daf9239aeb40c4a61a14de527dc954", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c1daf9239aeb40c4a61a14de527dc954"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c1daf9239aeb40c4a61a14de527dc954"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:38:14.911250 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant: tempest-VolumesNegativeTest-1624254314 Jul 15 15:38:14.911250 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Id: c1daf9239aeb40c4a61a14de527dc954 Jul 15 15:38:14.911250 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Name: tempest-VolumesNegativeTest-1624254314 Jul 15 15:38:14.911250 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User: tempest-VolumesNegativeTest-1624254314-project Jul 15 15:38:14.911250 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Id: default Jul 15 15:38:14.911250 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Name: Default Jul 15 15:38:14.911250 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Id: ca12aa795dd94e5aa83365cb096ca3ac Jul 15 15:38:14.911250 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Name: tempest-VolumesNegativeTest-1624254314-project Jul 15 15:38:14.911250 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Jul 15 15:38:14.911250 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-211360901", "metadata": {"Type": "work"}}} Jul 15 15:38:14.911250 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: method: Jul 15 15:38:14.911250 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 15 15:38:14.912266 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-211360901', 'metadata': {'Type': 'work'}}}} Jul 15 15:38:14.912266 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:38:14.912266 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:38:14.912266 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 15 15:38:14.912266 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 15 15:38:14.912266 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 15 15:38:14.912266 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise error Jul 15 15:38:14.912266 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 15 15:38:14.912266 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:38:14.912266 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 15 15:38:14.912266 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 15 15:38:14.912266 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:38:14.912266 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 15 15:38:14.912266 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi '#$%' Jul 15 15:38:14.912266 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:38:14.912266 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:38:14.912266 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:38:14.912266 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:38:14.912266 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:38:14.912266 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:38:14.912266 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:38:14.912266 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:38:14.914024 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 15:38:14.914024 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 15:38:14.914024 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:38:14.914024 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:38:14.914024 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 15 15:38:14.914024 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 15 15:38:14.914024 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 15 15:38:14.914024 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 15 15:38:14.914024 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 15 15:38:14.914024 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 15 15:38:14.914024 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 15 15:38:14.914024 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:38:14.914024 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:38:14.914024 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:38:14.914024 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:38:14.914024 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:38:14.914024 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:38:14.914024 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 15 15:38:14.914024 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 15 15:38:14.915534 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 15 15:38:14.915534 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:38:14.915534 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-ec952f85-b3db-4a08-96db-158120bf7e63 tempest-VolumesNegativeTest-1624254314 tempest-VolumesNegativeTest-1624254314-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:38:14.915534 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-ec952f85-b3db-4a08-96db-158120bf7e63 tempest-VolumesNegativeTest-1624254314 tempest-VolumesNegativeTest-1624254314-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.143045 Jul 15 15:38:14.915534 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 437/880] 10.222.0.40 () {60 vars in 1155 bytes} [Fri Jul 15 15:38:14 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 15 15:38:14.921740 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b1afc418-82f0-4c5e-9ec1-da9693692fd2 tempest-VolumesNegativeTest-1624254314 tempest-VolumesNegativeTest-1624254314-project] Action: 'create', calling method: .version_select at 0x7fe3c675fd30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-646859012", "metadata": {"Type": "work"}}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:38:14.924928 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b1afc418-82f0-4c5e-9ec1-da9693692fd2 tempest-VolumesNegativeTest-1624254314 tempest-VolumesNegativeTest-1624254314-project] Request method failure captured: Jul 15 15:38:14.924928 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 15 15:38:14.924928 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:38:14.924928 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:38:14.924928 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:38:14.924928 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 119 Jul 15 15:38:14.924928 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:38:14.924928 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:38:14.924928 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:38:14.924928 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:38:14.924928 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0YnmV6eArTLzMjy93qL4tto4MrBy21KOIp7WmsdApSpNleQGJHRlsBE70oaJGhyrNABxVyRh2uBv4zjvlMd3pC0WGUgNVuXlSijeiw-Wve-cW7q19-My3WH1K6_fd6HCrBzOl70bt9omRs18cBx0pixYF1W9HRD18bvkmItBT5JqBoo Jul 15 15:38:14.924928 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:38:14.924928 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:38:14.924928 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:38:14.924928 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:38:14.924928 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:38:14.924928 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:38:14.924928 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: c1daf9239aeb40c4a61a14de527dc954 Jul 15 15:38:14.924928 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-VolumesNegativeTest-1624254314 Jul 15 15:38:14.924928 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:38:14.924928 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:38:14.926554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c1daf9239aeb40c4a61a14de527dc954"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c1daf9239aeb40c4a61a14de527dc954", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c1daf9239aeb40c4a61a14de527dc954"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c1daf9239aeb40c4a61a14de527dc954"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:38:14.926554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-VolumesNegativeTest-1624254314 Jul 15 15:38:14.926554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: c1daf9239aeb40c4a61a14de527dc954 Jul 15 15:38:14.926554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-VolumesNegativeTest-1624254314 Jul 15 15:38:14.926554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-VolumesNegativeTest-1624254314-project Jul 15 15:38:14.926554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:38:14.926554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:38:14.926554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: ca12aa795dd94e5aa83365cb096ca3ac Jul 15 15:38:14.926554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-VolumesNegativeTest-1624254314-project Jul 15 15:38:14.926554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Jul 15 15:38:14.926554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-646859012", "metadata": {"Type": "work"}}} Jul 15 15:38:14.926554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: Jul 15 15:38:14.926554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 15 15:38:14.927540 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-646859012', 'metadata': {'Type': 'work'}}}} Jul 15 15:38:14.927540 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:38:14.927540 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:38:14.927540 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 15 15:38:14.927540 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 15 15:38:14.927540 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 15 15:38:14.927540 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise error Jul 15 15:38:14.927540 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 15 15:38:14.927540 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:38:14.927540 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 15 15:38:14.927540 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 15 15:38:14.927540 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:38:14.927540 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 15 15:38:14.927540 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi '0' Jul 15 15:38:14.927540 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:38:14.927540 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:38:14.927540 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:38:14.927540 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:38:14.927540 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:38:14.927540 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:38:14.927540 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:38:14.927540 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:38:14.929196 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 15:38:14.929196 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 15:38:14.929196 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:38:14.929196 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:38:14.929196 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 15 15:38:14.929196 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 15 15:38:14.929196 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 15 15:38:14.929196 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 15 15:38:14.929196 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 15 15:38:14.929196 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 15 15:38:14.929196 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 15 15:38:14.929196 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:38:14.929196 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:38:14.929196 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:38:14.929196 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:38:14.929196 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:38:14.929196 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:38:14.929196 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 15 15:38:14.929196 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 15 15:38:14.930544 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 15 15:38:14.930544 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:38:14.930544 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b1afc418-82f0-4c5e-9ec1-da9693692fd2 tempest-VolumesNegativeTest-1624254314 tempest-VolumesNegativeTest-1624254314-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:38:14.930544 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b1afc418-82f0-4c5e-9ec1-da9693692fd2 tempest-VolumesNegativeTest-1624254314 tempest-VolumesNegativeTest-1624254314-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009004 Jul 15 15:38:14.930544 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 444/881] 10.222.0.40 () {60 vars in 1155 bytes} [Fri Jul 15 15:38:14 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 15 15:38:14.938295 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-ec5d2324-3626-46e6-9736-e27bb5b84a25 tempest-VolumesNegativeTest-1624254314 tempest-VolumesNegativeTest-1624254314-project] Action: 'create', calling method: .version_select at 0x7fe3c66fa790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-421462155", "metadata": {"Type": "work"}}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:38:14.940958 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-ec5d2324-3626-46e6-9736-e27bb5b84a25 tempest-VolumesNegativeTest-1624254314 tempest-VolumesNegativeTest-1624254314-project] Request method failure captured: Jul 15 15:38:14.940958 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 15 15:38:14.940958 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept: application/json Jul 15 15:38:14.940958 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept-Encoding: identity Jul 15 15:38:14.940958 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Connection: close Jul 15 15:38:14.940958 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Length: 118 Jul 15 15:38:14.940958 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Type: application/json Jul 15 15:38:14.940958 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Host: 10.222.0.40 Jul 15 15:38:14.940958 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Openstack-System-Scope: None Jul 15 15:38:14.940958 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: User-Agent: python-urllib3/1.26.9 Jul 15 15:38:14.940958 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Auth-Token: gAAAAABi0YnmV6eArTLzMjy93qL4tto4MrBy21KOIp7WmsdApSpNleQGJHRlsBE70oaJGhyrNABxVyRh2uBv4zjvlMd3pC0WGUgNVuXlSijeiw-Wve-cW7q19-My3WH1K6_fd6HCrBzOl70bt9omRs18cBx0pixYF1W9HRD18bvkmItBT5JqBoo Jul 15 15:38:14.940958 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Id: None Jul 15 15:38:14.940958 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Name: None Jul 15 15:38:14.940958 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Identity-Status: Confirmed Jul 15 15:38:14.940958 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Is-Admin-Project: True Jul 15 15:38:14.940958 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Id: default Jul 15 15:38:14.940958 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Name: Default Jul 15 15:38:14.940958 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Id: c1daf9239aeb40c4a61a14de527dc954 Jul 15 15:38:14.940958 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Name: tempest-VolumesNegativeTest-1624254314 Jul 15 15:38:14.940958 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Role: member,reader Jul 15 15:38:14.940958 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Roles: member,reader Jul 15 15:38:14.942808 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c1daf9239aeb40c4a61a14de527dc954"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c1daf9239aeb40c4a61a14de527dc954", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c1daf9239aeb40c4a61a14de527dc954"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c1daf9239aeb40c4a61a14de527dc954"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:38:14.942808 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant: tempest-VolumesNegativeTest-1624254314 Jul 15 15:38:14.942808 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Id: c1daf9239aeb40c4a61a14de527dc954 Jul 15 15:38:14.942808 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Name: tempest-VolumesNegativeTest-1624254314 Jul 15 15:38:14.942808 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User: tempest-VolumesNegativeTest-1624254314-project Jul 15 15:38:14.942808 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Id: default Jul 15 15:38:14.942808 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Name: Default Jul 15 15:38:14.942808 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Id: ca12aa795dd94e5aa83365cb096ca3ac Jul 15 15:38:14.942808 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Name: tempest-VolumesNegativeTest-1624254314-project Jul 15 15:38:14.942808 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Jul 15 15:38:14.942808 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-421462155", "metadata": {"Type": "work"}}} Jul 15 15:38:14.942808 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: method: Jul 15 15:38:14.942808 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 15 15:38:14.943705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-421462155', 'metadata': {'Type': 'work'}}}} Jul 15 15:38:14.943705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:38:14.943705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:38:14.943705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 15 15:38:14.943705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 15 15:38:14.943705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 15 15:38:14.943705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise error Jul 15 15:38:14.943705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 15 15:38:14.943705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:38:14.943705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 15 15:38:14.943705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 15 15:38:14.943705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:38:14.943705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 15 15:38:14.943705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi '' Jul 15 15:38:14.943705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:38:14.943705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:38:14.943705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:38:14.943705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:38:14.943705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:38:14.943705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:38:14.943705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:38:14.943705 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:38:14.945096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 15:38:14.945096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 15:38:14.945096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:38:14.945096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:38:14.945096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 15 15:38:14.945096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 15 15:38:14.945096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 15 15:38:14.945096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 15 15:38:14.945096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 15 15:38:14.945096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 15 15:38:14.945096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 15 15:38:14.945096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:38:14.945096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:38:14.945096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:38:14.945096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:38:14.945096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:38:14.945096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:38:14.945096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 15 15:38:14.945096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 15 15:38:14.946347 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 15 15:38:14.946347 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:38:14.946347 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-ec5d2324-3626-46e6-9736-e27bb5b84a25 tempest-VolumesNegativeTest-1624254314 tempest-VolumesNegativeTest-1624254314-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:38:14.946347 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-ec5d2324-3626-46e6-9736-e27bb5b84a25 tempest-VolumesNegativeTest-1624254314 tempest-VolumesNegativeTest-1624254314-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009269 Jul 15 15:38:14.946347 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 438/882] 10.222.0.40 () {60 vars in 1155 bytes} [Fri Jul 15 15:38:14 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 15 15:38:14.954495 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c419904c-b5e1-4fea-9dc4-bb810c0f39b4 tempest-VolumesNegativeTest-1624254314 tempest-VolumesNegativeTest-1624254314-project] Calling method '.version_select at 0x7fe3c6790c10>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:38:14.986801 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-c419904c-b5e1-4fea-9dc4-bb810c0f39b4 tempest-VolumesNegativeTest-1624254314 tempest-VolumesNegativeTest-1624254314-project] HTTP exception thrown: Volume tempest-invalid-72009267 could not be found. Jul 15 15:38:14.988881 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c419904c-b5e1-4fea-9dc4-bb810c0f39b4 tempest-VolumesNegativeTest-1624254314 tempest-VolumesNegativeTest-1624254314-project] Request method failure captured: Jul 15 15:38:14.988881 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-72009267 HTTP/1.1 Jul 15 15:38:14.988881 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:38:14.988881 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:38:14.988881 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:38:14.988881 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 15 15:38:14.988881 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:38:14.988881 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:38:14.988881 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:38:14.988881 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:38:14.988881 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0YnmV6eArTLzMjy93qL4tto4MrBy21KOIp7WmsdApSpNleQGJHRlsBE70oaJGhyrNABxVyRh2uBv4zjvlMd3pC0WGUgNVuXlSijeiw-Wve-cW7q19-My3WH1K6_fd6HCrBzOl70bt9omRs18cBx0pixYF1W9HRD18bvkmItBT5JqBoo Jul 15 15:38:14.988881 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:38:14.988881 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:38:14.988881 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:38:14.988881 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:38:14.988881 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:38:14.988881 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:38:14.988881 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: c1daf9239aeb40c4a61a14de527dc954 Jul 15 15:38:14.988881 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-VolumesNegativeTest-1624254314 Jul 15 15:38:14.988881 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:38:14.988881 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:38:14.990562 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c1daf9239aeb40c4a61a14de527dc954"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c1daf9239aeb40c4a61a14de527dc954", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c1daf9239aeb40c4a61a14de527dc954"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c1daf9239aeb40c4a61a14de527dc954"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:38:14.990562 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-VolumesNegativeTest-1624254314 Jul 15 15:38:14.990562 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: c1daf9239aeb40c4a61a14de527dc954 Jul 15 15:38:14.990562 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-VolumesNegativeTest-1624254314 Jul 15 15:38:14.990562 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-VolumesNegativeTest-1624254314-project Jul 15 15:38:14.990562 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:38:14.990562 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:38:14.990562 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: ca12aa795dd94e5aa83365cb096ca3ac Jul 15 15:38:14.990562 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-VolumesNegativeTest-1624254314-project Jul 15 15:38:14.990562 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: Jul 15 15:38:14.990562 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Volume tempest-invalid-72009267 could not be found. Jul 15 15:38:14.990562 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'id': 'tempest-invalid-72009267'} Jul 15 15:38:14.990562 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:38:14.991471 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:38:14.991471 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 15:38:14.991471 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 15:38:14.991471 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 15:38:14.991471 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 15:38:14.991471 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 15:38:14.991471 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 15:38:14.991471 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 15:38:14.991471 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 15:38:14.991471 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 15:38:14.991471 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 15:38:14.991471 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:38:14.991471 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:38:14.991471 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:38:14.991471 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:38:14.991471 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-72009267 could not be found. (HTTP 404) (Request-ID: req-456aee4c-b332-49e2-97c3-c2d3f8f9fdf2) Jul 15 15:38:14.991471 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:38:14.991471 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:38:14.991471 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:38:14.992830 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:38:14.992830 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 15 15:38:14.992830 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 15 15:38:14.992830 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 15:38:14.992830 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 15:38:14.992830 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 15:38:14.992830 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 15:38:14.992830 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 15:38:14.992830 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 15:38:14.992830 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 15:38:14.992830 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 15:38:14.992830 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 15:38:14.992830 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 15:38:14.992830 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 15:38:14.992830 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 15:38:14.992830 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 15:38:14.992830 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 15:38:14.992830 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 15:38:14.992830 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 15:38:14.994164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:38:14.994164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:38:14.994164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:38:14.994164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:38:14.994164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-72009267 could not be found. Jul 15 15:38:14.994164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:38:14.994164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:38:14.994164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:38:14.994164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:38:14.994164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:38:14.994164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:38:14.994164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:38:14.994164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:38:14.994164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 15:38:14.994164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 15:38:14.994164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:38:14.994164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:38:14.994164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 15 15:38:14.994164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:38:14.994164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-72009267 could not be found. Jul 15 15:38:14.995425 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:38:14.995425 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:38:14.995425 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:38:14.995425 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:38:14.995425 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:38:14.995425 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:38:14.995425 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:38:14.995425 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:38:14.995425 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-72009267 could not be found. Jul 15 15:38:14.995425 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:38:14.995425 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c419904c-b5e1-4fea-9dc4-bb810c0f39b4 tempest-VolumesNegativeTest-1624254314 tempest-VolumesNegativeTest-1624254314-project] Returning 404 to user: Volume tempest-invalid-72009267 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:38:14.995425 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-c419904c-b5e1-4fea-9dc4-bb810c0f39b4 tempest-VolumesNegativeTest-1624254314 tempest-VolumesNegativeTest-1624254314-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/tempest-invalid-72009267" status: 404 len: 97 microversion: 2.1 time: 0.041123 Jul 15 15:38:14.995425 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 445/883] 10.222.0.40 () {58 vars in 1211 bytes} [Fri Jul 15 15:38:14 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-72009267 => generated 97 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 15 15:38:15.001532 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-22187daa-18c2-481b-a1f0-5e79b128869d tempest-VolumesNegativeTest-1624254314 tempest-VolumesNegativeTest-1624254314-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003908 Jul 15 15:38:15.002038 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 439/884] 10.222.0.40 () {58 vars in 1139 bytes} [Fri Jul 15 15:38:14 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 15 15:38:15.011753 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5f2617cc-146d-4bc2-a042-99538bcd7bed tempest-VolumesNegativeTest-1624254314 tempest-VolumesNegativeTest-1624254314-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004217 Jul 15 15:38:15.012283 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 446/885] 10.222.0.40 () {58 vars in 1136 bytes} [Fri Jul 15 15:38:15 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 15 15:38:15.022252 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-a454ec7e-10f3-4a00-acff-8cba86e2f1a5 tempest-VolumesNegativeTest-1624254314 tempest-VolumesNegativeTest-1624254314-project] Calling method '.version_select at 0x7fe3c67c7e50>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:38:15.050809 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.wsgi [None req-a454ec7e-10f3-4a00-acff-8cba86e2f1a5 tempest-VolumesNegativeTest-1624254314 tempest-VolumesNegativeTest-1624254314-project] HTTP exception thrown: Volume 51addec2-63e1-421f-8e4a-475e4b538fc9 could not be found. Jul 15 15:38:15.052787 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-a454ec7e-10f3-4a00-acff-8cba86e2f1a5 tempest-VolumesNegativeTest-1624254314 tempest-VolumesNegativeTest-1624254314-project] Request method failure captured: Jul 15 15:38:15.052787 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: request: DELETE /compute/v2.1/os-volumes/51addec2-63e1-421f-8e4a-475e4b538fc9 HTTP/1.1 Jul 15 15:38:15.052787 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept: application/json Jul 15 15:38:15.052787 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept-Encoding: identity Jul 15 15:38:15.052787 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Connection: close Jul 15 15:38:15.052787 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Length: 0 Jul 15 15:38:15.052787 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Type: application/json Jul 15 15:38:15.052787 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Host: 10.222.0.40 Jul 15 15:38:15.052787 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Openstack-System-Scope: None Jul 15 15:38:15.052787 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: User-Agent: python-urllib3/1.26.9 Jul 15 15:38:15.052787 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Auth-Token: gAAAAABi0YnmV6eArTLzMjy93qL4tto4MrBy21KOIp7WmsdApSpNleQGJHRlsBE70oaJGhyrNABxVyRh2uBv4zjvlMd3pC0WGUgNVuXlSijeiw-Wve-cW7q19-My3WH1K6_fd6HCrBzOl70bt9omRs18cBx0pixYF1W9HRD18bvkmItBT5JqBoo Jul 15 15:38:15.052787 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Id: None Jul 15 15:38:15.052787 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Name: None Jul 15 15:38:15.052787 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Identity-Status: Confirmed Jul 15 15:38:15.052787 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Is-Admin-Project: True Jul 15 15:38:15.052787 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Id: default Jul 15 15:38:15.052787 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Name: Default Jul 15 15:38:15.052787 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Id: c1daf9239aeb40c4a61a14de527dc954 Jul 15 15:38:15.052787 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Name: tempest-VolumesNegativeTest-1624254314 Jul 15 15:38:15.052787 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Role: member,reader Jul 15 15:38:15.052787 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Roles: member,reader Jul 15 15:38:15.054350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c1daf9239aeb40c4a61a14de527dc954"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c1daf9239aeb40c4a61a14de527dc954", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c1daf9239aeb40c4a61a14de527dc954"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c1daf9239aeb40c4a61a14de527dc954"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:38:15.054350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant: tempest-VolumesNegativeTest-1624254314 Jul 15 15:38:15.054350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Id: c1daf9239aeb40c4a61a14de527dc954 Jul 15 15:38:15.054350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Name: tempest-VolumesNegativeTest-1624254314 Jul 15 15:38:15.054350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User: tempest-VolumesNegativeTest-1624254314-project Jul 15 15:38:15.054350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Id: default Jul 15 15:38:15.054350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Name: Default Jul 15 15:38:15.054350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Id: ca12aa795dd94e5aa83365cb096ca3ac Jul 15 15:38:15.054350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Name: tempest-VolumesNegativeTest-1624254314-project Jul 15 15:38:15.054350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: method: Jul 15 15:38:15.054350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: exception: Volume 51addec2-63e1-421f-8e4a-475e4b538fc9 could not be found. Jul 15 15:38:15.054350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: action_args: {'id': '51addec2-63e1-421f-8e4a-475e4b538fc9'} Jul 15 15:38:15.054350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:38:15.055358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:38:15.055358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 15:38:15.055358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 15:38:15.055358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 15:38:15.055358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 15:38:15.055358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 15:38:15.055358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 15:38:15.055358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 15:38:15.055358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 15:38:15.055358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 15:38:15.055358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 15:38:15.055358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:38:15.055358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:38:15.055358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:38:15.055358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:38:15.055358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 51addec2-63e1-421f-8e4a-475e4b538fc9 could not be found. (HTTP 404) (Request-ID: req-e5d980b6-a1b5-41fb-9041-0e1b8ed6ee86) Jul 15 15:38:15.055358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:38:15.055358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:38:15.055358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:38:15.056740 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:38:15.056740 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 15 15:38:15.056740 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 15 15:38:15.056740 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 15:38:15.056740 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 15:38:15.056740 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 15:38:15.056740 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 15:38:15.056740 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 15:38:15.056740 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 15:38:15.056740 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 15:38:15.056740 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 15:38:15.056740 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 15:38:15.056740 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 15:38:15.056740 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 15:38:15.056740 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 15:38:15.056740 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 15:38:15.056740 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 15:38:15.056740 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 15:38:15.056740 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 15:38:15.058112 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:38:15.058112 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:38:15.058112 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:38:15.058112 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:38:15.058112 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 51addec2-63e1-421f-8e4a-475e4b538fc9 could not be found. Jul 15 15:38:15.058112 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:38:15.058112 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:38:15.058112 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:38:15.058112 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:38:15.058112 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:38:15.058112 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:38:15.058112 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:38:15.058112 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:38:15.058112 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 15:38:15.058112 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 15:38:15.058112 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:38:15.058112 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:38:15.058112 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 15 15:38:15.058112 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:38:15.059662 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 51addec2-63e1-421f-8e4a-475e4b538fc9 could not be found. Jul 15 15:38:15.059662 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:38:15.059662 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:38:15.059662 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:38:15.059662 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:38:15.059662 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:38:15.059662 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:38:15.059662 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:38:15.059662 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:38:15.059662 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 51addec2-63e1-421f-8e4a-475e4b538fc9 could not be found. Jul 15 15:38:15.059662 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:38:15.059662 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-a454ec7e-10f3-4a00-acff-8cba86e2f1a5 tempest-VolumesNegativeTest-1624254314 tempest-VolumesNegativeTest-1624254314-project] Returning 404 to user: Volume 51addec2-63e1-421f-8e4a-475e4b538fc9 could not be found. {{(pid=117999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:38:15.059662 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-a454ec7e-10f3-4a00-acff-8cba86e2f1a5 tempest-VolumesNegativeTest-1624254314 tempest-VolumesNegativeTest-1624254314-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/51addec2-63e1-421f-8e4a-475e4b538fc9" status: 404 len: 109 microversion: 2.1 time: 0.035984 Jul 15 15:38:15.059662 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 440/886] 10.222.0.40 () {58 vars in 1247 bytes} [Fri Jul 15 15:38:15 2022] DELETE /compute/v2.1/os-volumes/51addec2-63e1-421f-8e4a-475e4b538fc9 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:38:15.064827 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-baa373f7-c923-49b1-ae10-a24db030b859 tempest-VolumesNegativeTest-1624254314 tempest-VolumesNegativeTest-1624254314-project] Calling method '.version_select at 0x7fe3c66718b0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:38:15.096329 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-baa373f7-c923-49b1-ae10-a24db030b859 tempest-VolumesNegativeTest-1624254314 tempest-VolumesNegativeTest-1624254314-project] HTTP exception thrown: Volume 22a47319-9b57-4ea1-89eb-80fcd34beed6 could not be found. Jul 15 15:38:15.098275 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-baa373f7-c923-49b1-ae10-a24db030b859 tempest-VolumesNegativeTest-1624254314 tempest-VolumesNegativeTest-1624254314-project] Request method failure captured: Jul 15 15:38:15.098275 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/os-volumes/22a47319-9b57-4ea1-89eb-80fcd34beed6 HTTP/1.1 Jul 15 15:38:15.098275 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:38:15.098275 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:38:15.098275 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:38:15.098275 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 15 15:38:15.098275 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:38:15.098275 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:38:15.098275 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:38:15.098275 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:38:15.098275 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0YnmV6eArTLzMjy93qL4tto4MrBy21KOIp7WmsdApSpNleQGJHRlsBE70oaJGhyrNABxVyRh2uBv4zjvlMd3pC0WGUgNVuXlSijeiw-Wve-cW7q19-My3WH1K6_fd6HCrBzOl70bt9omRs18cBx0pixYF1W9HRD18bvkmItBT5JqBoo Jul 15 15:38:15.098275 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:38:15.098275 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:38:15.098275 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:38:15.098275 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:38:15.098275 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:38:15.098275 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:38:15.098275 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: c1daf9239aeb40c4a61a14de527dc954 Jul 15 15:38:15.098275 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-VolumesNegativeTest-1624254314 Jul 15 15:38:15.098275 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:38:15.098275 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:38:15.099989 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c1daf9239aeb40c4a61a14de527dc954"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c1daf9239aeb40c4a61a14de527dc954", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c1daf9239aeb40c4a61a14de527dc954"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c1daf9239aeb40c4a61a14de527dc954"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:38:15.099989 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-VolumesNegativeTest-1624254314 Jul 15 15:38:15.099989 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: c1daf9239aeb40c4a61a14de527dc954 Jul 15 15:38:15.099989 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-VolumesNegativeTest-1624254314 Jul 15 15:38:15.099989 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-VolumesNegativeTest-1624254314-project Jul 15 15:38:15.099989 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:38:15.099989 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:38:15.099989 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: ca12aa795dd94e5aa83365cb096ca3ac Jul 15 15:38:15.099989 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-VolumesNegativeTest-1624254314-project Jul 15 15:38:15.099989 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: Jul 15 15:38:15.099989 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Volume 22a47319-9b57-4ea1-89eb-80fcd34beed6 could not be found. Jul 15 15:38:15.099989 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'id': '22a47319-9b57-4ea1-89eb-80fcd34beed6'} Jul 15 15:38:15.099989 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:38:15.100912 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:38:15.100912 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 15:38:15.100912 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 15:38:15.100912 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 15:38:15.100912 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 15:38:15.100912 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 15:38:15.100912 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 15:38:15.100912 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 15:38:15.100912 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 15:38:15.100912 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 15:38:15.100912 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 15:38:15.100912 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:38:15.100912 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:38:15.100912 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:38:15.100912 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:38:15.100912 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 22a47319-9b57-4ea1-89eb-80fcd34beed6 could not be found. (HTTP 404) (Request-ID: req-3c2218dc-47db-47ee-8fab-41c677fdf36e) Jul 15 15:38:15.100912 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:38:15.100912 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:38:15.100912 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:38:15.102247 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:38:15.102247 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 15 15:38:15.102247 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 15 15:38:15.102247 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 15:38:15.102247 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 15:38:15.102247 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 15:38:15.102247 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 15:38:15.102247 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 15:38:15.102247 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 15:38:15.102247 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 15:38:15.102247 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 15:38:15.102247 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 15:38:15.102247 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 15:38:15.102247 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 15:38:15.102247 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 15:38:15.102247 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 15:38:15.102247 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 15:38:15.102247 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 15:38:15.102247 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 15:38:15.103663 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 15:38:15.103663 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 15:38:15.103663 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 15:38:15.103663 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 15:38:15.103663 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 22a47319-9b57-4ea1-89eb-80fcd34beed6 could not be found. Jul 15 15:38:15.103663 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:38:15.103663 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:38:15.103663 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:38:15.103663 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:38:15.103663 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:38:15.103663 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:38:15.103663 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:38:15.103663 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:38:15.103663 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 15:38:15.103663 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 15:38:15.103663 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:38:15.103663 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:38:15.103663 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 15 15:38:15.103663 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:38:15.105034 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 22a47319-9b57-4ea1-89eb-80fcd34beed6 could not be found. Jul 15 15:38:15.105034 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:38:15.105034 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:38:15.105034 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:38:15.105034 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:38:15.105034 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:38:15.105034 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:38:15.105034 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:38:15.105034 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:38:15.105034 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 22a47319-9b57-4ea1-89eb-80fcd34beed6 could not be found. Jul 15 15:38:15.105034 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:38:15.105034 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-baa373f7-c923-49b1-ae10-a24db030b859 tempest-VolumesNegativeTest-1624254314 tempest-VolumesNegativeTest-1624254314-project] Returning 404 to user: Volume 22a47319-9b57-4ea1-89eb-80fcd34beed6 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:38:15.105034 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-baa373f7-c923-49b1-ae10-a24db030b859 tempest-VolumesNegativeTest-1624254314 tempest-VolumesNegativeTest-1624254314-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/22a47319-9b57-4ea1-89eb-80fcd34beed6" status: 404 len: 109 microversion: 2.1 time: 0.039265 Jul 15 15:38:15.105034 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 447/887] 10.222.0.40 () {58 vars in 1244 bytes} [Fri Jul 15 15:38:15 2022] GET /compute/v2.1/os-volumes/22a47319-9b57-4ea1-89eb-80fcd34beed6 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:39:13.293823 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-bb1d663b-18ed-4b5e-9bce-1f13376d3b5d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:13.294912 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-bb1d663b-18ed-4b5e-9bce-1f13376d3b5d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:13.302182 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bb1d663b-18ed-4b5e-9bce-1f13376d3b5d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:13.302655 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bb1d663b-18ed-4b5e-9bce-1f13376d3b5d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:13.303426 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bb1d663b-18ed-4b5e-9bce-1f13376d3b5d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:13.303857 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bb1d663b-18ed-4b5e-9bce-1f13376d3b5d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:13.335580 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-bb1d663b-18ed-4b5e-9bce-1f13376d3b5d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046722 Jul 15 15:39:13.336150 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 441/888] 10.222.0.40 () {60 vars in 1342 bytes} [Fri Jul 15 15:39:13 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:39:13.400595 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-17028df8-57de-48a9-a389-56c4e1765912 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:13.401238 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-17028df8-57de-48a9-a389-56c4e1765912 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:13.407957 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-17028df8-57de-48a9-a389-56c4e1765912 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:13.408443 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-17028df8-57de-48a9-a389-56c4e1765912 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:13.409203 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-17028df8-57de-48a9-a389-56c4e1765912 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:13.409635 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-17028df8-57de-48a9-a389-56c4e1765912 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:13.440580 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-17028df8-57de-48a9-a389-56c4e1765912 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Going to try to terminate instance {{(pid=117998) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 15:39:13.528400 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-17028df8-57de-48a9-a389-56c4e1765912 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 204 len: 0 microversion: 2.20 time: 0.132031 Jul 15 15:39:13.529241 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 448/889] 10.222.0.40 () {60 vars in 1279 bytes} [Fri Jul 15 15:39:13 2022] DELETE /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 15 15:39:13.539378 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-2179e14b-eb56-464e-979b-6453c38fd977 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:13.540425 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-2179e14b-eb56-464e-979b-6453c38fd977 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:13.547508 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2179e14b-eb56-464e-979b-6453c38fd977 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:13.547956 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2179e14b-eb56-464e-979b-6453c38fd977 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:13.548719 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2179e14b-eb56-464e-979b-6453c38fd977 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:13.549171 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2179e14b-eb56-464e-979b-6453c38fd977 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:13.686512 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-2179e14b-eb56-464e-979b-6453c38fd977 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:13.694872 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-2179e14b-eb56-464e-979b-6453c38fd977 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:13.696351 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-2179e14b-eb56-464e-979b-6453c38fd977 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:13.697515 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-2179e14b-eb56-464e-979b-6453c38fd977 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1724 microversion: 2.20 time: 0.163032 Jul 15 15:39:13.698063 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 442/890] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:39:13 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:39:14.717404 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a69f690f-d095-4c09-aeec-9f48bdec12c3 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:14.718144 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a69f690f-d095-4c09-aeec-9f48bdec12c3 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:14.726026 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a69f690f-d095-4c09-aeec-9f48bdec12c3 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:14.726478 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a69f690f-d095-4c09-aeec-9f48bdec12c3 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:14.727368 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a69f690f-d095-4c09-aeec-9f48bdec12c3 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:14.727819 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a69f690f-d095-4c09-aeec-9f48bdec12c3 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:14.875567 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a69f690f-d095-4c09-aeec-9f48bdec12c3 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:14.885381 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a69f690f-d095-4c09-aeec-9f48bdec12c3 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:14.887981 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a69f690f-d095-4c09-aeec-9f48bdec12c3 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:14.889355 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a69f690f-d095-4c09-aeec-9f48bdec12c3 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1724 microversion: 2.20 time: 0.176775 Jul 15 15:39:14.889954 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 449/891] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:39:14 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:39:15.910218 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-935bf4da-5a29-4da7-b005-9d33018cbfe5 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:15.911639 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-935bf4da-5a29-4da7-b005-9d33018cbfe5 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:15.918878 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-935bf4da-5a29-4da7-b005-9d33018cbfe5 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:15.919574 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-935bf4da-5a29-4da7-b005-9d33018cbfe5 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:15.920357 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-935bf4da-5a29-4da7-b005-9d33018cbfe5 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:15.920796 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-935bf4da-5a29-4da7-b005-9d33018cbfe5 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:16.164486 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-935bf4da-5a29-4da7-b005-9d33018cbfe5 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:16.173272 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-935bf4da-5a29-4da7-b005-9d33018cbfe5 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:16.175034 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-935bf4da-5a29-4da7-b005-9d33018cbfe5 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:16.176333 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-935bf4da-5a29-4da7-b005-9d33018cbfe5 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1724 microversion: 2.20 time: 0.270446 Jul 15 15:39:16.188190 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 443/892] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:39:15 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:39:16.628596 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-0102ec3f-342d-4883-934e-5a2071e6aaf4 req-1039c84c-493a-476a-a74c-1a3539d5381a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a2a79d6-dd6d-4d59-a58c-11252d834add", "name": "network-vif-deleted", "tag": "06b33828-c90f-45fb-839b-8fd1808f8a80"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:39:16.643461 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-0102ec3f-342d-4883-934e-5a2071e6aaf4 req-1039c84c-493a-476a-a74c-1a3539d5381a service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:16.644377 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-0102ec3f-342d-4883-934e-5a2071e6aaf4 req-1039c84c-493a-476a-a74c-1a3539d5381a service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:16.665913 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-0102ec3f-342d-4883-934e-5a2071e6aaf4 req-1039c84c-493a-476a-a74c-1a3539d5381a service nova] Creating event network-vif-deleted:06b33828-c90f-45fb-839b-8fd1808f8a80 for instance 0a2a79d6-dd6d-4d59-a58c-11252d834add on hv-cinder-85001 Jul 15 15:39:16.672326 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-0102ec3f-342d-4883-934e-5a2071e6aaf4 req-1039c84c-493a-476a-a74c-1a3539d5381a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054189 Jul 15 15:39:16.676246 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 450/893] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:39:17.199509 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-c3bf4f66-310a-4ea1-b880-9a1cb30a0b8b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:17.203885 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-c3bf4f66-310a-4ea1-b880-9a1cb30a0b8b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:17.219949 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c3bf4f66-310a-4ea1-b880-9a1cb30a0b8b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:17.221291 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c3bf4f66-310a-4ea1-b880-9a1cb30a0b8b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:17.222347 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c3bf4f66-310a-4ea1-b880-9a1cb30a0b8b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:17.223429 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c3bf4f66-310a-4ea1-b880-9a1cb30a0b8b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:17.264349 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c3bf4f66-310a-4ea1-b880-9a1cb30a0b8b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:17.265063 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c3bf4f66-310a-4ea1-b880-9a1cb30a0b8b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:17.265679 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.objects.instance [None req-c3bf4f66-310a-4ea1-b880-9a1cb30a0b8b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lazy-loading 'fault' on Instance uuid 0a2a79d6-dd6d-4d59-a58c-11252d834add {{(pid=117999) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:39:17.315628 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-c3bf4f66-310a-4ea1-b880-9a1cb30a0b8b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:17.330473 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-c3bf4f66-310a-4ea1-b880-9a1cb30a0b8b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:17.332223 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-c3bf4f66-310a-4ea1-b880-9a1cb30a0b8b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a0d49b3b50b4e668e157cb2e8e47da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cbbde066834f25a1b6f1bdc28e8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:17.333658 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-c3bf4f66-310a-4ea1-b880-9a1cb30a0b8b tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 200 len: 1371 microversion: 2.20 time: 0.140935 Jul 15 15:39:17.334309 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 444/894] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:39:17 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 1371 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 15:39:18.357230 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a102014d-f684-413d-aeac-f46b3ccd8328 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:18.358218 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a102014d-f684-413d-aeac-f46b3ccd8328 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:18.365352 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a102014d-f684-413d-aeac-f46b3ccd8328 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:18.365748 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a102014d-f684-413d-aeac-f46b3ccd8328 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:18.366772 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a102014d-f684-413d-aeac-f46b3ccd8328 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:18.367199 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a102014d-f684-413d-aeac-f46b3ccd8328 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:18.382020 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-a102014d-f684-413d-aeac-f46b3ccd8328 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] HTTP exception thrown: Instance 0a2a79d6-dd6d-4d59-a58c-11252d834add could not be found. Jul 15 15:39:18.383943 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a102014d-f684-413d-aeac-f46b3ccd8328 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Request method failure captured: Jul 15 15:39:18.383943 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add HTTP/1.1 Jul 15 15:39:18.383943 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:39:18.383943 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:39:18.383943 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:39:18.383943 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 15 15:39:18.383943 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:39:18.383943 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:39:18.383943 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:39:18.383943 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:39:18.383943 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0Ycdl5fjv0GHXFYBY8Oj0p_9neOe7aiKLzORnSELZ9fjLn5e5jx-OviD5zymv1hQZjQuA9wjjXExczrciWHH70PFyn90e-Zx5GZfnJGwRvsgtphfFMDIPu7StCyyWG4lRPjFEc89gd3qabEUSD3Ln52Ln4H4tGcPXeHNw7hKu44XOMo Jul 15 15:39:18.383943 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:39:18.383943 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:39:18.383943 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:39:18.383943 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:39:18.383943 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 15:39:18.383943 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:39:18.383943 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:39:18.383943 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: 83cbbde066834f25a1b6f1bdc28e8b79 Jul 15 15:39:18.383943 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-871086534 Jul 15 15:39:18.383943 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:39:18.383943 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:39:18.385682 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/83cbbde066834f25a1b6f1bdc28e8b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_83cbbde066834f25a1b6f1bdc28e8b79", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/83cbbde066834f25a1b6f1bdc28e8b79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/83cbbde066834f25a1b6f1bdc28e8b79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:39:18.385682 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-AttachVolumeShelveTestJSON-871086534 Jul 15 15:39:18.385682 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 83cbbde066834f25a1b6f1bdc28e8b79 Jul 15 15:39:18.385682 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-871086534 Jul 15 15:39:18.385682 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-AttachVolumeShelveTestJSON-871086534-project Jul 15 15:39:18.385682 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:39:18.385682 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:39:18.385682 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: 9a0d49b3b50b4e668e157cb2e8e47da2 Jul 15 15:39:18.385682 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-AttachVolumeShelveTestJSON-871086534-project Jul 15 15:39:18.385682 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: > Jul 15 15:39:18.385682 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Instance 0a2a79d6-dd6d-4d59-a58c-11252d834add could not be found. Jul 15 15:39:18.385682 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'id': '0a2a79d6-dd6d-4d59-a58c-11252d834add'} Jul 15 15:39:18.386857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:39:18.386857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:39:18.386857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:39:18.386857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:39:18.386857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:39:18.386857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:39:18.386857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:39:18.386857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:39:18.386857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:39:18.386857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:39:18.386857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a2a79d6-dd6d-4d59-a58c-11252d834add could not be found. Jul 15 15:39:18.386857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:39:18.386857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:39:18.386857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:39:18.386857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:39:18.386857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:39:18.386857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:39:18.386857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:39:18.386857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:39:18.386857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:39:18.388822 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:39:18.388822 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:39:18.388822 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:39:18.388822 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:39:18.388822 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:39:18.388822 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:39:18.388822 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:39:18.388822 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a2a79d6-dd6d-4d59-a58c-11252d834add could not be found. Jul 15 15:39:18.388822 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:39:18.388822 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:39:18.388822 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:39:18.388822 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:39:18.388822 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:39:18.388822 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:39:18.388822 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:39:18.388822 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:39:18.388822 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a2a79d6-dd6d-4d59-a58c-11252d834add could not be found. Jul 15 15:39:18.388822 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:39:18.390035 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a102014d-f684-413d-aeac-f46b3ccd8328 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Returning 404 to user: Instance 0a2a79d6-dd6d-4d59-a58c-11252d834add could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:39:18.390035 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a102014d-f684-413d-aeac-f46b3ccd8328 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 404 len: 111 microversion: 2.20 time: 0.033915 Jul 15 15:39:18.390035 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 451/895] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:39:18 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 15 15:39:18.395695 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-6c0a8314-874b-46e0-8c57-2c0aced8d91d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '.version_select at 0x7fe3c671cc10>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:18.415051 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-6c0a8314-874b-46e0-8c57-2c0aced8d91d tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1968229912" status: 204 len: 0 microversion: 2.20 time: 0.023196 Jul 15 15:39:18.415628 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 445/896] 10.222.0.40 () {60 vars in 1261 bytes} [Fri Jul 15 15:39:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1968229912 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 15 15:39:20.285507 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d4158d27-5e11-44b3-84d4-960a4d975998 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:20.286012 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d4158d27-5e11-44b3-84d4-960a4d975998 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:20.292789 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d4158d27-5e11-44b3-84d4-960a4d975998 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:20.293242 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d4158d27-5e11-44b3-84d4-960a4d975998 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:20.293989 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d4158d27-5e11-44b3-84d4-960a4d975998 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:20.294491 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d4158d27-5e11-44b3-84d4-960a4d975998 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:20.308795 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-d4158d27-5e11-44b3-84d4-960a4d975998 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] HTTP exception thrown: Instance 0a2a79d6-dd6d-4d59-a58c-11252d834add could not be found. Jul 15 15:39:20.310332 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d4158d27-5e11-44b3-84d4-960a4d975998 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Request method failure captured: Jul 15 15:39:20.310332 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: DELETE /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add HTTP/1.1 Jul 15 15:39:20.310332 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:39:20.310332 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:39:20.310332 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:39:20.310332 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 15 15:39:20.310332 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:39:20.310332 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:39:20.310332 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:39:20.310332 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:39:20.310332 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0Ycdl5fjv0GHXFYBY8Oj0p_9neOe7aiKLzORnSELZ9fjLn5e5jx-OviD5zymv1hQZjQuA9wjjXExczrciWHH70PFyn90e-Zx5GZfnJGwRvsgtphfFMDIPu7StCyyWG4lRPjFEc89gd3qabEUSD3Ln52Ln4H4tGcPXeHNw7hKu44XOMo Jul 15 15:39:20.310332 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:39:20.310332 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:39:20.310332 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:39:20.310332 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:39:20.310332 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 15:39:20.310332 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:39:20.310332 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:39:20.310332 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: 83cbbde066834f25a1b6f1bdc28e8b79 Jul 15 15:39:20.310332 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-871086534 Jul 15 15:39:20.310332 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:39:20.310332 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:39:20.312679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/83cbbde066834f25a1b6f1bdc28e8b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_83cbbde066834f25a1b6f1bdc28e8b79", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/83cbbde066834f25a1b6f1bdc28e8b79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/83cbbde066834f25a1b6f1bdc28e8b79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:39:20.312679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-AttachVolumeShelveTestJSON-871086534 Jul 15 15:39:20.312679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 83cbbde066834f25a1b6f1bdc28e8b79 Jul 15 15:39:20.312679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-871086534 Jul 15 15:39:20.312679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-AttachVolumeShelveTestJSON-871086534-project Jul 15 15:39:20.312679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:39:20.312679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:39:20.312679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: 9a0d49b3b50b4e668e157cb2e8e47da2 Jul 15 15:39:20.312679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-AttachVolumeShelveTestJSON-871086534-project Jul 15 15:39:20.312679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: > Jul 15 15:39:20.312679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Instance 0a2a79d6-dd6d-4d59-a58c-11252d834add could not be found. Jul 15 15:39:20.312679 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'id': '0a2a79d6-dd6d-4d59-a58c-11252d834add'} Jul 15 15:39:20.313908 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:39:20.313908 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:39:20.313908 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:39:20.313908 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:39:20.313908 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:39:20.313908 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:39:20.313908 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:39:20.313908 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:39:20.313908 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:39:20.313908 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:39:20.313908 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a2a79d6-dd6d-4d59-a58c-11252d834add could not be found. Jul 15 15:39:20.313908 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:39:20.313908 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:39:20.313908 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:39:20.313908 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:39:20.313908 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:39:20.313908 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:39:20.313908 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:39:20.313908 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:39:20.313908 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:39:20.316073 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:39:20.316073 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 15:39:20.316073 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 15:39:20.316073 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 15:39:20.316073 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 15:39:20.316073 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:39:20.316073 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:39:20.316073 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:39:20.316073 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:39:20.316073 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a2a79d6-dd6d-4d59-a58c-11252d834add could not be found. Jul 15 15:39:20.316073 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:39:20.316073 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:39:20.316073 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:39:20.316073 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:39:20.316073 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:39:20.316073 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:39:20.316073 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:39:20.316073 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:39:20.316073 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a2a79d6-dd6d-4d59-a58c-11252d834add could not be found. Jul 15 15:39:20.316073 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:39:20.318179 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d4158d27-5e11-44b3-84d4-960a4d975998 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Returning 404 to user: Instance 0a2a79d6-dd6d-4d59-a58c-11252d834add could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:39:20.318179 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d4158d27-5e11-44b3-84d4-960a4d975998 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 404 len: 111 microversion: 2.20 time: 0.030487 Jul 15 15:39:20.318179 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 452/897] 10.222.0.40 () {60 vars in 1279 bytes} [Fri Jul 15 15:39:20 2022] DELETE /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 15 15:39:20.322578 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3d30c4a7-0ae7-443f-a609-1d9ecd64cf80 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:20.323220 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-3d30c4a7-0ae7-443f-a609-1d9ecd64cf80 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 0a2a79d6-dd6d-4d59-a58c-11252d834add] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:20.332919 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3d30c4a7-0ae7-443f-a609-1d9ecd64cf80 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:20.333421 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3d30c4a7-0ae7-443f-a609-1d9ecd64cf80 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:20.334256 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3d30c4a7-0ae7-443f-a609-1d9ecd64cf80 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:20.334764 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3d30c4a7-0ae7-443f-a609-1d9ecd64cf80 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:20.351333 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.wsgi [None req-3d30c4a7-0ae7-443f-a609-1d9ecd64cf80 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] HTTP exception thrown: Instance 0a2a79d6-dd6d-4d59-a58c-11252d834add could not be found. Jul 15 15:39:20.353046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3d30c4a7-0ae7-443f-a609-1d9ecd64cf80 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Request method failure captured: Jul 15 15:39:20.353046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: request: GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add HTTP/1.1 Jul 15 15:39:20.353046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept: application/json Jul 15 15:39:20.353046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept-Encoding: identity Jul 15 15:39:20.353046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Connection: close Jul 15 15:39:20.353046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Length: 0 Jul 15 15:39:20.353046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Type: application/json Jul 15 15:39:20.353046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Host: 10.222.0.40 Jul 15 15:39:20.353046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Openstack-System-Scope: None Jul 15 15:39:20.353046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: User-Agent: python-urllib3/1.26.9 Jul 15 15:39:20.353046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Auth-Token: gAAAAABi0Ycdl5fjv0GHXFYBY8Oj0p_9neOe7aiKLzORnSELZ9fjLn5e5jx-OviD5zymv1hQZjQuA9wjjXExczrciWHH70PFyn90e-Zx5GZfnJGwRvsgtphfFMDIPu7StCyyWG4lRPjFEc89gd3qabEUSD3Ln52Ln4H4tGcPXeHNw7hKu44XOMo Jul 15 15:39:20.353046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Id: None Jul 15 15:39:20.353046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Name: None Jul 15 15:39:20.353046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Identity-Status: Confirmed Jul 15 15:39:20.353046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Is-Admin-Project: True Jul 15 15:39:20.353046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 15:39:20.353046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Id: default Jul 15 15:39:20.353046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Name: Default Jul 15 15:39:20.353046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Id: 83cbbde066834f25a1b6f1bdc28e8b79 Jul 15 15:39:20.353046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-871086534 Jul 15 15:39:20.353046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Role: member,reader Jul 15 15:39:20.353046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Roles: member,reader Jul 15 15:39:20.354770 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/83cbbde066834f25a1b6f1bdc28e8b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_83cbbde066834f25a1b6f1bdc28e8b79", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/83cbbde066834f25a1b6f1bdc28e8b79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/83cbbde066834f25a1b6f1bdc28e8b79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:39:20.354770 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant: tempest-AttachVolumeShelveTestJSON-871086534 Jul 15 15:39:20.354770 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Id: 83cbbde066834f25a1b6f1bdc28e8b79 Jul 15 15:39:20.354770 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-871086534 Jul 15 15:39:20.354770 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User: tempest-AttachVolumeShelveTestJSON-871086534-project Jul 15 15:39:20.354770 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Id: default Jul 15 15:39:20.354770 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Name: Default Jul 15 15:39:20.354770 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Id: 9a0d49b3b50b4e668e157cb2e8e47da2 Jul 15 15:39:20.354770 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Name: tempest-AttachVolumeShelveTestJSON-871086534-project Jul 15 15:39:20.354770 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: method: > Jul 15 15:39:20.354770 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: exception: Instance 0a2a79d6-dd6d-4d59-a58c-11252d834add could not be found. Jul 15 15:39:20.354770 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: action_args: {'id': '0a2a79d6-dd6d-4d59-a58c-11252d834add'} Jul 15 15:39:20.355616 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:39:20.355616 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:39:20.355616 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:39:20.355616 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:39:20.355616 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:39:20.355616 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:39:20.355616 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:39:20.355616 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:39:20.355616 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:39:20.355616 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:39:20.355616 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a2a79d6-dd6d-4d59-a58c-11252d834add could not be found. Jul 15 15:39:20.355616 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:39:20.355616 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:39:20.355616 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:39:20.355616 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:39:20.355616 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:39:20.355616 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:39:20.355616 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:39:20.355616 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:39:20.355616 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:39:20.358169 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:39:20.358169 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:39:20.358169 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:39:20.358169 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:39:20.358169 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:39:20.358169 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:39:20.358169 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:39:20.358169 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a2a79d6-dd6d-4d59-a58c-11252d834add could not be found. Jul 15 15:39:20.358169 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:39:20.358169 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:39:20.358169 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:39:20.358169 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:39:20.358169 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:39:20.358169 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:39:20.358169 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:39:20.358169 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:39:20.358169 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a2a79d6-dd6d-4d59-a58c-11252d834add could not be found. Jul 15 15:39:20.358169 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:39:20.360037 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3d30c4a7-0ae7-443f-a609-1d9ecd64cf80 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Returning 404 to user: Instance 0a2a79d6-dd6d-4d59-a58c-11252d834add could not be found. {{(pid=117999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:39:20.360037 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-3d30c4a7-0ae7-443f-a609-1d9ecd64cf80 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add" status: 404 len: 111 microversion: 2.20 time: 0.037170 Jul 15 15:39:20.360037 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 446/898] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:39:20 2022] GET /compute/v2.1/servers/0a2a79d6-dd6d-4d59-a58c-11252d834add => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 15 15:39:21.541083 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6f066a5b-abdc-4b65-90f7-171c9d102213 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:21.541782 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6f066a5b-abdc-4b65-90f7-171c9d102213 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:21.548022 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6f066a5b-abdc-4b65-90f7-171c9d102213 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:21.548441 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6f066a5b-abdc-4b65-90f7-171c9d102213 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:21.549529 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6f066a5b-abdc-4b65-90f7-171c9d102213 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:21.550064 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6f066a5b-abdc-4b65-90f7-171c9d102213 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:21.565552 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-6f066a5b-abdc-4b65-90f7-171c9d102213 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] HTTP exception thrown: Instance 5180ff6f-38fa-49c2-9663-9269dcae4849 could not be found. Jul 15 15:39:21.567241 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6f066a5b-abdc-4b65-90f7-171c9d102213 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Request method failure captured: Jul 15 15:39:21.567241 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: DELETE /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 HTTP/1.1 Jul 15 15:39:21.567241 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:39:21.567241 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:39:21.567241 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:39:21.567241 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 15 15:39:21.567241 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:39:21.567241 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:39:21.567241 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:39:21.567241 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:39:21.567241 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0Ycdl5fjv0GHXFYBY8Oj0p_9neOe7aiKLzORnSELZ9fjLn5e5jx-OviD5zymv1hQZjQuA9wjjXExczrciWHH70PFyn90e-Zx5GZfnJGwRvsgtphfFMDIPu7StCyyWG4lRPjFEc89gd3qabEUSD3Ln52Ln4H4tGcPXeHNw7hKu44XOMo Jul 15 15:39:21.567241 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:39:21.567241 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:39:21.567241 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:39:21.567241 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:39:21.567241 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 15:39:21.567241 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:39:21.567241 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:39:21.567241 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: 83cbbde066834f25a1b6f1bdc28e8b79 Jul 15 15:39:21.567241 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-871086534 Jul 15 15:39:21.567241 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:39:21.567241 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:39:21.568954 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/83cbbde066834f25a1b6f1bdc28e8b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_83cbbde066834f25a1b6f1bdc28e8b79", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/83cbbde066834f25a1b6f1bdc28e8b79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/83cbbde066834f25a1b6f1bdc28e8b79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:39:21.568954 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-AttachVolumeShelveTestJSON-871086534 Jul 15 15:39:21.568954 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 83cbbde066834f25a1b6f1bdc28e8b79 Jul 15 15:39:21.568954 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-871086534 Jul 15 15:39:21.568954 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-AttachVolumeShelveTestJSON-871086534-project Jul 15 15:39:21.568954 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:39:21.568954 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:39:21.568954 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: 9a0d49b3b50b4e668e157cb2e8e47da2 Jul 15 15:39:21.568954 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-AttachVolumeShelveTestJSON-871086534-project Jul 15 15:39:21.568954 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: > Jul 15 15:39:21.568954 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Instance 5180ff6f-38fa-49c2-9663-9269dcae4849 could not be found. Jul 15 15:39:21.568954 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'id': '5180ff6f-38fa-49c2-9663-9269dcae4849'} Jul 15 15:39:21.570000 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:39:21.570000 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:39:21.570000 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:39:21.570000 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:39:21.570000 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:39:21.570000 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:39:21.570000 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:39:21.570000 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:39:21.570000 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:39:21.570000 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:39:21.570000 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5180ff6f-38fa-49c2-9663-9269dcae4849 could not be found. Jul 15 15:39:21.570000 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:39:21.570000 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:39:21.570000 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:39:21.570000 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:39:21.570000 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:39:21.570000 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:39:21.570000 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:39:21.570000 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:39:21.570000 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:39:21.571656 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:39:21.571656 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 15:39:21.571656 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 15:39:21.571656 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 15:39:21.571656 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 15:39:21.571656 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:39:21.571656 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:39:21.571656 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:39:21.571656 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:39:21.571656 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5180ff6f-38fa-49c2-9663-9269dcae4849 could not be found. Jul 15 15:39:21.571656 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:39:21.571656 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:39:21.571656 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:39:21.571656 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:39:21.571656 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:39:21.571656 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:39:21.571656 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:39:21.571656 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:39:21.571656 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5180ff6f-38fa-49c2-9663-9269dcae4849 could not be found. Jul 15 15:39:21.571656 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:39:21.572923 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6f066a5b-abdc-4b65-90f7-171c9d102213 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Returning 404 to user: Instance 5180ff6f-38fa-49c2-9663-9269dcae4849 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:39:21.572923 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6f066a5b-abdc-4b65-90f7-171c9d102213 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 404 len: 111 microversion: 2.20 time: 0.031760 Jul 15 15:39:21.572923 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 453/899] 10.222.0.40 () {60 vars in 1279 bytes} [Fri Jul 15 15:39:21 2022] DELETE /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 15 15:39:21.579235 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-4536acf1-90be-4655-b23f-b706c571b512 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:21.579898 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-4536acf1-90be-4655-b23f-b706c571b512 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] [instance: 5180ff6f-38fa-49c2-9663-9269dcae4849] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:21.586738 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4536acf1-90be-4655-b23f-b706c571b512 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:21.587213 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4536acf1-90be-4655-b23f-b706c571b512 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:21.588045 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4536acf1-90be-4655-b23f-b706c571b512 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:21.588505 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4536acf1-90be-4655-b23f-b706c571b512 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:21.602397 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.wsgi [None req-4536acf1-90be-4655-b23f-b706c571b512 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] HTTP exception thrown: Instance 5180ff6f-38fa-49c2-9663-9269dcae4849 could not be found. Jul 15 15:39:21.603934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-4536acf1-90be-4655-b23f-b706c571b512 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Request method failure captured: Jul 15 15:39:21.603934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: request: GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 HTTP/1.1 Jul 15 15:39:21.603934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept: application/json Jul 15 15:39:21.603934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept-Encoding: identity Jul 15 15:39:21.603934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Connection: close Jul 15 15:39:21.603934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Length: 0 Jul 15 15:39:21.603934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Type: application/json Jul 15 15:39:21.603934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Host: 10.222.0.40 Jul 15 15:39:21.603934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Openstack-System-Scope: None Jul 15 15:39:21.603934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: User-Agent: python-urllib3/1.26.9 Jul 15 15:39:21.603934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Auth-Token: gAAAAABi0Ycdl5fjv0GHXFYBY8Oj0p_9neOe7aiKLzORnSELZ9fjLn5e5jx-OviD5zymv1hQZjQuA9wjjXExczrciWHH70PFyn90e-Zx5GZfnJGwRvsgtphfFMDIPu7StCyyWG4lRPjFEc89gd3qabEUSD3Ln52Ln4H4tGcPXeHNw7hKu44XOMo Jul 15 15:39:21.603934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Id: None Jul 15 15:39:21.603934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Name: None Jul 15 15:39:21.603934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Identity-Status: Confirmed Jul 15 15:39:21.603934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Is-Admin-Project: True Jul 15 15:39:21.603934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 15:39:21.603934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Id: default Jul 15 15:39:21.603934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Name: Default Jul 15 15:39:21.603934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Id: 83cbbde066834f25a1b6f1bdc28e8b79 Jul 15 15:39:21.603934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-871086534 Jul 15 15:39:21.603934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Role: member,reader Jul 15 15:39:21.603934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Roles: member,reader Jul 15 15:39:21.605791 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/83cbbde066834f25a1b6f1bdc28e8b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_83cbbde066834f25a1b6f1bdc28e8b79", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/83cbbde066834f25a1b6f1bdc28e8b79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/83cbbde066834f25a1b6f1bdc28e8b79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:39:21.605791 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant: tempest-AttachVolumeShelveTestJSON-871086534 Jul 15 15:39:21.605791 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Id: 83cbbde066834f25a1b6f1bdc28e8b79 Jul 15 15:39:21.605791 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-871086534 Jul 15 15:39:21.605791 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User: tempest-AttachVolumeShelveTestJSON-871086534-project Jul 15 15:39:21.605791 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Id: default Jul 15 15:39:21.605791 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Name: Default Jul 15 15:39:21.605791 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Id: 9a0d49b3b50b4e668e157cb2e8e47da2 Jul 15 15:39:21.605791 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Name: tempest-AttachVolumeShelveTestJSON-871086534-project Jul 15 15:39:21.605791 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: method: > Jul 15 15:39:21.605791 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: exception: Instance 5180ff6f-38fa-49c2-9663-9269dcae4849 could not be found. Jul 15 15:39:21.605791 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: action_args: {'id': '5180ff6f-38fa-49c2-9663-9269dcae4849'} Jul 15 15:39:21.606785 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:39:21.606785 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:39:21.606785 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:39:21.606785 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:39:21.606785 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:39:21.606785 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:39:21.606785 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:39:21.606785 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:39:21.606785 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:39:21.606785 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:39:21.606785 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5180ff6f-38fa-49c2-9663-9269dcae4849 could not be found. Jul 15 15:39:21.606785 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:39:21.606785 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:39:21.606785 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:39:21.606785 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:39:21.606785 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:39:21.606785 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:39:21.606785 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:39:21.606785 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:39:21.606785 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:39:21.608580 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:39:21.608580 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:39:21.608580 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:39:21.608580 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:39:21.608580 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:39:21.608580 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:39:21.608580 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:39:21.608580 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5180ff6f-38fa-49c2-9663-9269dcae4849 could not be found. Jul 15 15:39:21.608580 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:39:21.608580 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:39:21.608580 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:39:21.608580 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:39:21.608580 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:39:21.608580 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:39:21.608580 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:39:21.608580 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:39:21.608580 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5180ff6f-38fa-49c2-9663-9269dcae4849 could not be found. Jul 15 15:39:21.608580 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:39:21.610140 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-4536acf1-90be-4655-b23f-b706c571b512 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] Returning 404 to user: Instance 5180ff6f-38fa-49c2-9663-9269dcae4849 could not be found. {{(pid=117999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:39:21.610140 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-4536acf1-90be-4655-b23f-b706c571b512 tempest-AttachVolumeShelveTestJSON-871086534 tempest-AttachVolumeShelveTestJSON-871086534-project] 10.222.0.40 "GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849" status: 404 len: 111 microversion: 2.20 time: 0.031299 Jul 15 15:39:21.610140 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 447/900] 10.222.0.40 () {60 vars in 1276 bytes} [Fri Jul 15 15:39:21 2022] GET /compute/v2.1/servers/5180ff6f-38fa-49c2-9663-9269dcae4849 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 15 15:39:32.916952 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:39:32.918211 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:39:33.103510 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f7d3010e-74ae-49b0-8c99-6d3fb73f56cc tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Action: 'create', calling method: .version_select at 0x7fe3c6671ee0>, body: {"keypair": {"name": "tempest-keypair-1844761330", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJylFLefdJJ6auxbPGjpvFfCvYy+azq1Ha+g/iadhmefeo4GGaerDK8jLUv/ugJO4OslZ3+2zrkZ0EXHhx8Nf7W9wbQn1j9XZ6NRdrMAGIDn0Kdt6muMToTZrzz/I4WKNw=="}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:39:33.118774 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-f7d3010e-74ae-49b0-8c99-6d3fb73f56cc tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Getting quotas for project 46caece212e44751ba83b3dbfc8176ee. Resources: {'key_pairs'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:39:33.123168 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-f7d3010e-74ae-49b0-8c99-6d3fb73f56cc tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Getting quotas for user 862f9a645a6f4ffe8c0518504ed6d47c and project 46caece212e44751ba83b3dbfc8176ee. Resources: {'key_pairs'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:39:33.151510 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f7d3010e-74ae-49b0-8c99-6d3fb73f56cc tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.240101 Jul 15 15:39:33.152101 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 454/901] 10.222.0.40 () {60 vars in 1158 bytes} [Fri Jul 15 15:39:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:39:34.838226 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-a3398198-ca7e-47ed-9114-a273d3d78342 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-765889811", "imageRef": "b9770891-ef3b-4f53-a989-3a4db420d5c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2849d693-fbe8-4fb0-bb77-6756df5e3eca"}], "security_groups": [{"name": "tempest-securitygroup--2108750472"}], "key_name": "tempest-keypair-1844761330", "user_data": "}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:39:34.848209 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:39:34.848966 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=30 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:39:34.965124 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.network.neutron [None req-a3398198-ca7e-47ed-9114-a273d3d78342 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] validate_networks() for [('2849d693-fbe8-4fb0-bb77-6756df5e3eca', None, None, None, None, None)] {{(pid=117999) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:39:35.545114 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-a3398198-ca7e-47ed-9114-a273d3d78342 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Flavor limits 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:39:35.545762 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-a3398198-ca7e-47ed-9114-a273d3d78342 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Image limits 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:39:35.546465 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-a3398198-ca7e-47ed-9114-a273d3d78342 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Flavor pref 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:39:35.547053 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-a3398198-ca7e-47ed-9114-a273d3d78342 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Image pref 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:39:35.547665 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-a3398198-ca7e-47ed-9114-a273d3d78342 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:39:35.560434 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a3398198-ca7e-47ed-9114-a273d3d78342 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:35.561090 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a3398198-ca7e-47ed-9114-a273d3d78342 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:35.561946 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a3398198-ca7e-47ed-9114-a273d3d78342 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:35.562497 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a3398198-ca7e-47ed-9114-a273d3d78342 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:35.584171 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-a3398198-ca7e-47ed-9114-a273d3d78342 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Getting quotas for project 46caece212e44751ba83b3dbfc8176ee. Resources: {'ram', 'instances', 'cores'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:39:35.589426 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-a3398198-ca7e-47ed-9114-a273d3d78342 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Getting quotas for user 862f9a645a6f4ffe8c0518504ed6d47c and project 46caece212e44751ba83b3dbfc8176ee. Resources: {'ram', 'instances', 'cores'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:39:35.603231 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-a3398198-ca7e-47ed-9114-a273d3d78342 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Going to run 1 instances... {{(pid=117999) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:39:35.605901 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-a3398198-ca7e-47ed-9114-a273d3d78342 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9770891-ef3b-4f53-a989-3a4db420d5c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117999) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:39:35.687707 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-a3398198-ca7e-47ed-9114-a273d3d78342 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.857043 Jul 15 15:39:35.689400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 448/902] 10.222.0.40 () {60 vars in 1146 bytes} [Fri Jul 15 15:39:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 15:39:35.709768 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-828cc72f-cd2d-4a4d-baef-4b7d80e6fec1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:35.711255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-828cc72f-cd2d-4a4d-baef-4b7d80e6fec1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:35.812327 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-828cc72f-cd2d-4a4d-baef-4b7d80e6fec1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:35.824506 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-828cc72f-cd2d-4a4d-baef-4b7d80e6fec1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b" status: 200 len: 1241 microversion: 2.1 time: 0.124826 Jul 15 15:39:35.825766 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 455/903] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:39:35 2022] GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b => generated 1241 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:39:36.854373 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-d1a53486-cff1-4a9f-b76a-68d16843cf2c tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:36.860111 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-d1a53486-cff1-4a9f-b76a-68d16843cf2c tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:36.934771 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-d1a53486-cff1-4a9f-b76a-68d16843cf2c tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:36.956309 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-d1a53486-cff1-4a9f-b76a-68d16843cf2c tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b" status: 200 len: 1241 microversion: 2.1 time: 0.107713 Jul 15 15:39:36.958129 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 449/904] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:39:36 2022] GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b => generated 1241 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:39:37.976928 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-88b63150-44e8-4c19-96c4-b9cd95f3ff09 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:37.977767 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-88b63150-44e8-4c19-96c4-b9cd95f3ff09 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:38.039242 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-88b63150-44e8-4c19-96c4-b9cd95f3ff09 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:38.046558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-88b63150-44e8-4c19-96c4-b9cd95f3ff09 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b" status: 200 len: 1241 microversion: 2.1 time: 0.073648 Jul 15 15:39:38.047162 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 456/905] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:39:37 2022] GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:39:39.064810 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-34dac2b3-c152-467f-9755-ce167f0e275e tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:39.065417 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-34dac2b3-c152-467f-9755-ce167f0e275e tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:39.136805 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-34dac2b3-c152-467f-9755-ce167f0e275e tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:39.143972 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-34dac2b3-c152-467f-9755-ce167f0e275e tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b" status: 200 len: 1241 microversion: 2.1 time: 0.083346 Jul 15 15:39:39.144549 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 450/906] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:39:39 2022] GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:39:40.161223 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ceba1037-7fa9-40d2-a9ba-668454dc75d1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:40.161863 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ceba1037-7fa9-40d2-a9ba-668454dc75d1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:40.170015 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ceba1037-7fa9-40d2-a9ba-668454dc75d1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:40.170558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ceba1037-7fa9-40d2-a9ba-668454dc75d1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:40.171411 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ceba1037-7fa9-40d2-a9ba-668454dc75d1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:40.171883 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ceba1037-7fa9-40d2-a9ba-668454dc75d1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:40.248782 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ceba1037-7fa9-40d2-a9ba-668454dc75d1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:40.258241 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ceba1037-7fa9-40d2-a9ba-668454dc75d1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b" status: 200 len: 1245 microversion: 2.1 time: 0.100866 Jul 15 15:39:40.259108 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 457/907] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:39:40 2022] GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b => generated 1245 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:39:41.276237 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-34559634-3fa7-4e34-8ae6-3af7b97f6876 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:41.277172 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-34559634-3fa7-4e34-8ae6-3af7b97f6876 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:41.286127 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-34559634-3fa7-4e34-8ae6-3af7b97f6876 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:41.286613 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-34559634-3fa7-4e34-8ae6-3af7b97f6876 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:41.287620 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-34559634-3fa7-4e34-8ae6-3af7b97f6876 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:41.288087 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-34559634-3fa7-4e34-8ae6-3af7b97f6876 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:41.384552 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-34559634-3fa7-4e34-8ae6-3af7b97f6876 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:41.398063 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-34559634-3fa7-4e34-8ae6-3af7b97f6876 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b" status: 200 len: 1299 microversion: 2.1 time: 0.126114 Jul 15 15:39:41.399126 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 451/908] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:39:41 2022] GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b => generated 1299 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:39:42.426912 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ff221733-ba9c-4cc2-94ac-a4ff58396488 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:42.428301 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ff221733-ba9c-4cc2-94ac-a4ff58396488 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:42.442917 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ff221733-ba9c-4cc2-94ac-a4ff58396488 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:42.448082 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ff221733-ba9c-4cc2-94ac-a4ff58396488 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:42.449488 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ff221733-ba9c-4cc2-94ac-a4ff58396488 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:42.450168 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ff221733-ba9c-4cc2-94ac-a4ff58396488 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:42.702599 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ff221733-ba9c-4cc2-94ac-a4ff58396488 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:42.715527 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ff221733-ba9c-4cc2-94ac-a4ff58396488 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b" status: 200 len: 1367 microversion: 2.1 time: 0.297683 Jul 15 15:39:42.716394 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 458/909] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:39:42 2022] GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b => generated 1367 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:39:42.874750 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-efeeb37d-6c21-4a91-9764-ad7173a36030 req-2f79afc9-2202-494f-9cbe-cc9819fa811c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21725c3f-9223-4166-ab4e-58710b60743b", "tag": "34f7ccc3-7013-46b4-b000-655458a36009"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:39:42.895189 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-efeeb37d-6c21-4a91-9764-ad7173a36030 req-2f79afc9-2202-494f-9cbe-cc9819fa811c service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:42.897861 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-efeeb37d-6c21-4a91-9764-ad7173a36030 req-2f79afc9-2202-494f-9cbe-cc9819fa811c service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:42.918426 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-efeeb37d-6c21-4a91-9764-ad7173a36030 req-2f79afc9-2202-494f-9cbe-cc9819fa811c service nova] Creating event network-changed:34f7ccc3-7013-46b4-b000-655458a36009 for instance 21725c3f-9223-4166-ab4e-58710b60743b on hv-cinder-85001 Jul 15 15:39:42.930498 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-efeeb37d-6c21-4a91-9764-ad7173a36030 req-2f79afc9-2202-494f-9cbe-cc9819fa811c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065175 Jul 15 15:39:42.932669 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 452/910] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:39:43.739515 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-96aae64b-7dc1-4abf-9a89-3f26a7cf7697 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:43.740145 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-96aae64b-7dc1-4abf-9a89-3f26a7cf7697 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:43.746942 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-96aae64b-7dc1-4abf-9a89-3f26a7cf7697 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:43.747374 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-96aae64b-7dc1-4abf-9a89-3f26a7cf7697 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:43.748135 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-96aae64b-7dc1-4abf-9a89-3f26a7cf7697 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:43.748555 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-96aae64b-7dc1-4abf-9a89-3f26a7cf7697 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:43.917084 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-96aae64b-7dc1-4abf-9a89-3f26a7cf7697 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:43.925536 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-96aae64b-7dc1-4abf-9a89-3f26a7cf7697 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b" status: 200 len: 1367 microversion: 2.1 time: 0.189972 Jul 15 15:39:43.926081 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 459/911] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:39:43 2022] GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:39:44.954314 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-b0e95e01-6844-497e-9f15-9b8f2a9ff496 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:44.955583 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-b0e95e01-6844-497e-9f15-9b8f2a9ff496 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:44.964633 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b0e95e01-6844-497e-9f15-9b8f2a9ff496 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:44.965445 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b0e95e01-6844-497e-9f15-9b8f2a9ff496 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:44.966861 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b0e95e01-6844-497e-9f15-9b8f2a9ff496 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:44.967509 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b0e95e01-6844-497e-9f15-9b8f2a9ff496 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:45.126567 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b0e95e01-6844-497e-9f15-9b8f2a9ff496 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:45.136719 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-b0e95e01-6844-497e-9f15-9b8f2a9ff496 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b" status: 200 len: 1367 microversion: 2.1 time: 0.190062 Jul 15 15:39:45.137454 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 453/912] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:39:44 2022] GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:39:46.157037 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5abbb315-62ff-45b9-8077-b3884abc7137 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:46.158209 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5abbb315-62ff-45b9-8077-b3884abc7137 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:46.170338 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5abbb315-62ff-45b9-8077-b3884abc7137 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:46.171227 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5abbb315-62ff-45b9-8077-b3884abc7137 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:46.172833 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5abbb315-62ff-45b9-8077-b3884abc7137 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:46.173736 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5abbb315-62ff-45b9-8077-b3884abc7137 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:46.458026 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5abbb315-62ff-45b9-8077-b3884abc7137 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:46.469311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5abbb315-62ff-45b9-8077-b3884abc7137 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b" status: 200 len: 1367 microversion: 2.1 time: 0.318397 Jul 15 15:39:46.470422 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 460/913] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:39:46 2022] GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b => generated 1367 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:39:47.494995 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3656e60d-7fc2-4dee-b41b-d079b9b494b5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:47.495807 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-3656e60d-7fc2-4dee-b41b-d079b9b494b5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:47.497872 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=2 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:39:47.504833 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3656e60d-7fc2-4dee-b41b-d079b9b494b5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:47.505267 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3656e60d-7fc2-4dee-b41b-d079b9b494b5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:47.506060 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3656e60d-7fc2-4dee-b41b-d079b9b494b5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:47.506479 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3656e60d-7fc2-4dee-b41b-d079b9b494b5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:47.674560 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3656e60d-7fc2-4dee-b41b-d079b9b494b5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:47.684621 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-3656e60d-7fc2-4dee-b41b-d079b9b494b5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b" status: 200 len: 1367 microversion: 2.1 time: 0.193762 Jul 15 15:39:47.685521 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 454/914] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:39:47 2022] GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:39:48.393486 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a7e0058d-d30a-4efe-98a1-00713d6f2bbe tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:48.394487 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a7e0058d-d30a-4efe-98a1-00713d6f2bbe tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:48.398265 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=8 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:39:48.404985 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a7e0058d-d30a-4efe-98a1-00713d6f2bbe tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:48.405428 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a7e0058d-d30a-4efe-98a1-00713d6f2bbe tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:48.406220 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a7e0058d-d30a-4efe-98a1-00713d6f2bbe tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:48.406672 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a7e0058d-d30a-4efe-98a1-00713d6f2bbe tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:48.442360 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a7e0058d-d30a-4efe-98a1-00713d6f2bbe tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec] Going to try to terminate instance {{(pid=117998) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 15:39:48.544510 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a7e0058d-d30a-4efe-98a1-00713d6f2bbe tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec" status: 204 len: 0 microversion: 2.1 time: 0.156282 Jul 15 15:39:48.545941 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 461/915] 10.222.0.40 () {58 vars in 1238 bytes} [Fri Jul 15 15:39:48 2022] DELETE /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:39:48.558962 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3d0c2892-a67c-4e46-9c13-2a4c79e778d9 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:48.560639 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-3d0c2892-a67c-4e46-9c13-2a4c79e778d9 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:48.572584 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3d0c2892-a67c-4e46-9c13-2a4c79e778d9 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:48.573891 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3d0c2892-a67c-4e46-9c13-2a4c79e778d9 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:48.575308 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3d0c2892-a67c-4e46-9c13-2a4c79e778d9 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:48.576071 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3d0c2892-a67c-4e46-9c13-2a4c79e778d9 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:48.712098 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3a31f394-4b77-4386-8387-868a9b16785e tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:48.713641 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3a31f394-4b77-4386-8387-868a9b16785e tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:48.722398 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3a31f394-4b77-4386-8387-868a9b16785e tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:48.722877 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3a31f394-4b77-4386-8387-868a9b16785e tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:48.724195 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3a31f394-4b77-4386-8387-868a9b16785e tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:48.724578 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3a31f394-4b77-4386-8387-868a9b16785e tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:48.888860 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3d0c2892-a67c-4e46-9c13-2a4c79e778d9 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:48.899400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-3d0c2892-a67c-4e46-9c13-2a4c79e778d9 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec" status: 200 len: 1576 microversion: 2.1 time: 0.348534 Jul 15 15:39:48.900605 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 455/916] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:39:48 2022] GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec => generated 1576 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:39:48.906113 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-a40b3cbf-e364-40f9-8522-0c4e46c6cdd9 req-8543a144-31dd-40f6-acad-ea1ee1b65ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21725c3f-9223-4166-ab4e-58710b60743b", "name": "network-vif-plugged", "status": "completed", "tag": "34f7ccc3-7013-46b4-b000-655458a36009"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:39:48.918243 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-a40b3cbf-e364-40f9-8522-0c4e46c6cdd9 req-8543a144-31dd-40f6-acad-ea1ee1b65ade service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:48.918982 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-a40b3cbf-e364-40f9-8522-0c4e46c6cdd9 req-8543a144-31dd-40f6-acad-ea1ee1b65ade service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:48.952114 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-a40b3cbf-e364-40f9-8522-0c4e46c6cdd9 req-8543a144-31dd-40f6-acad-ea1ee1b65ade service nova] Creating event network-vif-plugged:34f7ccc3-7013-46b4-b000-655458a36009 for instance 21725c3f-9223-4166-ab4e-58710b60743b on hv-cinder-85001 Jul 15 15:39:48.962834 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-a40b3cbf-e364-40f9-8522-0c4e46c6cdd9 req-8543a144-31dd-40f6-acad-ea1ee1b65ade service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060542 Jul 15 15:39:48.963994 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 456/917] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:39:48.989442 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3a31f394-4b77-4386-8387-868a9b16785e tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:48.999287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3a31f394-4b77-4386-8387-868a9b16785e tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b" status: 200 len: 1367 microversion: 2.1 time: 0.296615 Jul 15 15:39:49.000288 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 462/918] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:39:48 2022] GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b => generated 1367 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:39:49.048831 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 15:39:49.049305 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Fri Jul 15 15:39:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 15:39:49.931177 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-cefbe9ef-ffda-44f2-9338-6ca627c667e6 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:49.933025 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-cefbe9ef-ffda-44f2-9338-6ca627c667e6 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:49.941200 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=10 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:39:49.947200 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cefbe9ef-ffda-44f2-9338-6ca627c667e6 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:49.948276 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cefbe9ef-ffda-44f2-9338-6ca627c667e6 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:49.949884 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cefbe9ef-ffda-44f2-9338-6ca627c667e6 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:49.950962 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-cefbe9ef-ffda-44f2-9338-6ca627c667e6 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:50.018233 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d27e8d5c-cedc-4b02-83d0-dfd0db0ca4b7 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:50.019958 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d27e8d5c-cedc-4b02-83d0-dfd0db0ca4b7 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:50.030703 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d27e8d5c-cedc-4b02-83d0-dfd0db0ca4b7 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:50.032387 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d27e8d5c-cedc-4b02-83d0-dfd0db0ca4b7 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:50.033836 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d27e8d5c-cedc-4b02-83d0-dfd0db0ca4b7 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:50.034733 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d27e8d5c-cedc-4b02-83d0-dfd0db0ca4b7 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:50.239694 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-cefbe9ef-ffda-44f2-9338-6ca627c667e6 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:50.247755 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-cefbe9ef-ffda-44f2-9338-6ca627c667e6 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec" status: 200 len: 1576 microversion: 2.1 time: 0.323345 Jul 15 15:39:50.249258 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 457/919] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:39:49 2022] GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec => generated 1576 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:39:50.273348 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d27e8d5c-cedc-4b02-83d0-dfd0db0ca4b7 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:50.281248 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d27e8d5c-cedc-4b02-83d0-dfd0db0ca4b7 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b" status: 200 len: 1367 microversion: 2.1 time: 0.267303 Jul 15 15:39:50.281838 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 463/920] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:39:50 2022] GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:39:51.274772 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-162cd17b-cc16-479b-86d5-41d7e3c7eac6 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:51.277707 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-162cd17b-cc16-479b-86d5-41d7e3c7eac6 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:51.290337 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-162cd17b-cc16-479b-86d5-41d7e3c7eac6 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:51.291626 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-162cd17b-cc16-479b-86d5-41d7e3c7eac6 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:51.293960 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-162cd17b-cc16-479b-86d5-41d7e3c7eac6 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:51.294549 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-162cd17b-cc16-479b-86d5-41d7e3c7eac6 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:51.305458 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b46ee0f3-a7ea-4597-9071-0edb954379d1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:51.307149 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b46ee0f3-a7ea-4597-9071-0edb954379d1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:51.335458 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b46ee0f3-a7ea-4597-9071-0edb954379d1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:51.336255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b46ee0f3-a7ea-4597-9071-0edb954379d1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:51.337231 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b46ee0f3-a7ea-4597-9071-0edb954379d1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:51.337882 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b46ee0f3-a7ea-4597-9071-0edb954379d1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:51.880140 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b46ee0f3-a7ea-4597-9071-0edb954379d1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:51.883719 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-162cd17b-cc16-479b-86d5-41d7e3c7eac6 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:51.897624 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b46ee0f3-a7ea-4597-9071-0edb954379d1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b" status: 200 len: 1367 microversion: 2.1 time: 0.600675 Jul 15 15:39:51.902353 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-162cd17b-cc16-479b-86d5-41d7e3c7eac6 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec" status: 200 len: 1576 microversion: 2.1 time: 0.635617 Jul 15 15:39:51.907906 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 458/921] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:39:51 2022] GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec => generated 1576 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:39:51.925542 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 464/922] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:39:51 2022] GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b => generated 1367 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:39:52.931457 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-fff76963-033a-4ba5-b3a5-241d66c272b8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:52.933728 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-fff76963-033a-4ba5-b3a5-241d66c272b8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:52.936077 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3de2e4d7-08be-49d7-8ff3-61df419da31e tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:52.937006 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3de2e4d7-08be-49d7-8ff3-61df419da31e tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:52.947408 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fff76963-033a-4ba5-b3a5-241d66c272b8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:52.950184 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fff76963-033a-4ba5-b3a5-241d66c272b8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:52.950935 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fff76963-033a-4ba5-b3a5-241d66c272b8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:52.951375 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fff76963-033a-4ba5-b3a5-241d66c272b8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:52.964432 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3de2e4d7-08be-49d7-8ff3-61df419da31e tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:52.965082 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3de2e4d7-08be-49d7-8ff3-61df419da31e tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:52.966326 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3de2e4d7-08be-49d7-8ff3-61df419da31e tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:52.967019 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3de2e4d7-08be-49d7-8ff3-61df419da31e tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:53.352866 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-fff76963-033a-4ba5-b3a5-241d66c272b8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:53.374944 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-fff76963-033a-4ba5-b3a5-241d66c272b8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec" status: 200 len: 1509 microversion: 2.1 time: 0.450770 Jul 15 15:39:53.376080 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 459/923] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:39:52 2022] GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec => generated 1509 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:39:53.587826 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3de2e4d7-08be-49d7-8ff3-61df419da31e tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:53.615420 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-db8c683f-64da-4654-8943-52db68e0a09d req-239a8e77-4f7a-4d60-be82-7aa2985a4d66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec", "name": "network-vif-deleted", "tag": "51cdf260-8522-4ae6-84c4-b058d8c52d32"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:39:53.624645 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3de2e4d7-08be-49d7-8ff3-61df419da31e tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b" status: 200 len: 1558 microversion: 2.1 time: 0.695017 Jul 15 15:39:53.628905 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 465/924] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:39:52 2022] GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b => generated 1558 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:39:53.651428 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-db8c683f-64da-4654-8943-52db68e0a09d req-239a8e77-4f7a-4d60-be82-7aa2985a4d66 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:53.652595 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-db8c683f-64da-4654-8943-52db68e0a09d req-239a8e77-4f7a-4d60-be82-7aa2985a4d66 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:53.663798 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1680a712-5567-4cdb-b108-b70108738c0f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:53.665241 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1680a712-5567-4cdb-b108-b70108738c0f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:53.685059 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1680a712-5567-4cdb-b108-b70108738c0f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:53.686989 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1680a712-5567-4cdb-b108-b70108738c0f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:53.690285 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1680a712-5567-4cdb-b108-b70108738c0f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:53.691120 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1680a712-5567-4cdb-b108-b70108738c0f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:53.696286 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-db8c683f-64da-4654-8943-52db68e0a09d req-239a8e77-4f7a-4d60-be82-7aa2985a4d66 service nova] Creating event network-vif-deleted:51cdf260-8522-4ae6-84c4-b058d8c52d32 for instance e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec on hv-cinder-85001 Jul 15 15:39:53.708583 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-db8c683f-64da-4654-8943-52db68e0a09d req-239a8e77-4f7a-4d60-be82-7aa2985a4d66 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098644 Jul 15 15:39:53.709985 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 460/925] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:39:53.877983 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1680a712-5567-4cdb-b108-b70108738c0f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.221067 Jul 15 15:39:53.879843 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 466/926] 10.222.0.40 () {58 vars in 1274 bytes} [Fri Jul 15 15:39:53 2022] GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b/os-interface => generated 285 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:39:54.403596 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-738a509b-695d-4801-bd94-f69a8288986c tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:54.404283 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-738a509b-695d-4801-bd94-f69a8288986c tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:54.423905 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-738a509b-695d-4801-bd94-f69a8288986c tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:54.424407 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-738a509b-695d-4801-bd94-f69a8288986c tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:54.425231 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-738a509b-695d-4801-bd94-f69a8288986c tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:54.425876 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-738a509b-695d-4801-bd94-f69a8288986c tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:54.532915 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-738a509b-695d-4801-bd94-f69a8288986c tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:54.535211 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-738a509b-695d-4801-bd94-f69a8288986c tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:54.535973 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.objects.instance [None req-738a509b-695d-4801-bd94-f69a8288986c tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lazy-loading 'fault' on Instance uuid e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec {{(pid=117999) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:39:54.691009 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-738a509b-695d-4801-bd94-f69a8288986c tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:54.702097 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-738a509b-695d-4801-bd94-f69a8288986c tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec" status: 200 len: 1184 microversion: 2.1 time: 0.306161 Jul 15 15:39:54.703926 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 461/927] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:39:54 2022] GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec => generated 1184 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:39:55.727475 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-924ca948-000f-4d41-bf24-f86488e7efdb tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:55.729711 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-924ca948-000f-4d41-bf24-f86488e7efdb tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:55.745853 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-924ca948-000f-4d41-bf24-f86488e7efdb tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:55.746745 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-924ca948-000f-4d41-bf24-f86488e7efdb tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:55.748574 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-924ca948-000f-4d41-bf24-f86488e7efdb tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:55.749558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-924ca948-000f-4d41-bf24-f86488e7efdb tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:55.781044 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-924ca948-000f-4d41-bf24-f86488e7efdb tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] HTTP exception thrown: Instance e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec could not be found. Jul 15 15:39:55.785491 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-924ca948-000f-4d41-bf24-f86488e7efdb tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Request method failure captured: Jul 15 15:39:55.785491 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec HTTP/1.1 Jul 15 15:39:55.785491 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:39:55.785491 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:39:55.785491 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:39:55.785491 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 15 15:39:55.785491 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:39:55.785491 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:39:55.785491 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:39:55.785491 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:39:55.785491 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0Yl3QyrwtcbE0Ohi9-IO2YJ45afwfKgzLdgCybs6siBE9y46qz8tzFFpUyiTeQzV2H47EEhDK8CRZfduO9MKkzGgbZsVNVLqhbxNZoCEver6kKU0wQPuI5NeZKHqIT9ErBTukewrBScSw5VC8j8qY6e0-deV-h4pvoVwhEU2BT8lNKA Jul 15 15:39:55.785491 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:39:55.785491 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:39:55.785491 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:39:55.785491 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:39:55.785491 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:39:55.785491 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:39:55.785491 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: 9bda8b2837a54ec5a75c7dc355571255 Jul 15 15:39:55.785491 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-TestVolumeBootPattern-809271764 Jul 15 15:39:55.785491 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:39:55.785491 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:39:55.788394 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9bda8b2837a54ec5a75c7dc355571255"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9bda8b2837a54ec5a75c7dc355571255", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9bda8b2837a54ec5a75c7dc355571255"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9bda8b2837a54ec5a75c7dc355571255"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:39:55.788394 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-TestVolumeBootPattern-809271764 Jul 15 15:39:55.788394 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 9bda8b2837a54ec5a75c7dc355571255 Jul 15 15:39:55.788394 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-TestVolumeBootPattern-809271764 Jul 15 15:39:55.788394 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-TestVolumeBootPattern-809271764-project Jul 15 15:39:55.788394 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:39:55.788394 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:39:55.788394 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: 4453bd7126a849f29cfe3d8bdf4531f1 Jul 15 15:39:55.788394 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-TestVolumeBootPattern-809271764-project Jul 15 15:39:55.788394 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: > Jul 15 15:39:55.788394 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Instance e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec could not be found. Jul 15 15:39:55.788394 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'id': 'e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec'} Jul 15 15:39:55.790004 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:39:55.790004 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:39:55.790004 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:39:55.790004 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:39:55.790004 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:39:55.790004 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:39:55.790004 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:39:55.790004 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:39:55.790004 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:39:55.790004 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:39:55.790004 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec could not be found. Jul 15 15:39:55.790004 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:39:55.790004 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:39:55.790004 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:39:55.790004 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:39:55.790004 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:39:55.790004 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:39:55.790004 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:39:55.790004 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:39:55.790004 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:39:55.794941 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:39:55.794941 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:39:55.794941 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:39:55.794941 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:39:55.794941 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:39:55.794941 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:39:55.794941 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:39:55.794941 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec could not be found. Jul 15 15:39:55.794941 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:39:55.794941 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:39:55.794941 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:39:55.794941 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:39:55.794941 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:39:55.794941 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:39:55.794941 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:39:55.794941 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:39:55.794941 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec could not be found. Jul 15 15:39:55.794941 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:39:55.801862 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-924ca948-000f-4d41-bf24-f86488e7efdb tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Returning 404 to user: Instance e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:39:55.801862 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-924ca948-000f-4d41-bf24-f86488e7efdb tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec" status: 404 len: 111 microversion: 2.1 time: 0.068807 Jul 15 15:39:55.803171 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 467/928] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:39:55 2022] GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 15 15:39:55.972278 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-02a73792-6714-43c6-9916-c7667462b9bf tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1498777893", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1986937243", "security_groups": [{"name": "tempest-secgroup-smoke-153259507"}], "block_device_mapping_v2": [{"uuid": "2b80b97a-06e6-4568-96bc-285acafff267", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9b60a386-f1f7-4772-81d0-41c3770d705b"}]}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:39:56.088741 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-4f1776e2-0b3d-42ce-9430-d8ecc4212a3f req-884383a6-d933-4c1c-bd08-714096810833 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21725c3f-9223-4166-ab4e-58710b60743b", "tag": "34f7ccc3-7013-46b4-b000-655458a36009"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:39:56.104100 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-4f1776e2-0b3d-42ce-9430-d8ecc4212a3f req-884383a6-d933-4c1c-bd08-714096810833 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:56.105168 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-4f1776e2-0b3d-42ce-9430-d8ecc4212a3f req-884383a6-d933-4c1c-bd08-714096810833 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:56.125517 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-4f1776e2-0b3d-42ce-9430-d8ecc4212a3f req-884383a6-d933-4c1c-bd08-714096810833 service nova] Creating event network-changed:34f7ccc3-7013-46b4-b000-655458a36009 for instance 21725c3f-9223-4166-ab4e-58710b60743b on hv-cinder-85001 Jul 15 15:39:56.129638 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.network.neutron [None req-02a73792-6714-43c6-9916-c7667462b9bf tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] validate_networks() for [('9b60a386-f1f7-4772-81d0-41c3770d705b', None, None, None, None, None)] {{(pid=117998) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:39:56.137313 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-4f1776e2-0b3d-42ce-9430-d8ecc4212a3f req-884383a6-d933-4c1c-bd08-714096810833 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.324929 Jul 15 15:39:56.138976 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 462/929] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:39:57.102900 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-02a73792-6714-43c6-9916-c7667462b9bf tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Flavor limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:39:57.104303 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-02a73792-6714-43c6-9916-c7667462b9bf tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Image limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:39:57.106247 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-02a73792-6714-43c6-9916-c7667462b9bf tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Flavor pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:39:57.107308 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-02a73792-6714-43c6-9916-c7667462b9bf tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Image pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:39:57.107903 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-02a73792-6714-43c6-9916-c7667462b9bf tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:39:57.123281 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-02a73792-6714-43c6-9916-c7667462b9bf tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:57.124937 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-02a73792-6714-43c6-9916-c7667462b9bf tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:57.126716 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-02a73792-6714-43c6-9916-c7667462b9bf tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:39:57.127343 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-02a73792-6714-43c6-9916-c7667462b9bf tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:39:57.157567 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-02a73792-6714-43c6-9916-c7667462b9bf tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Getting quotas for project 9bda8b2837a54ec5a75c7dc355571255. Resources: {'ram', 'instances', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:39:57.166019 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-02a73792-6714-43c6-9916-c7667462b9bf tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Getting quotas for user 4453bd7126a849f29cfe3d8bdf4531f1 and project 9bda8b2837a54ec5a75c7dc355571255. Resources: {'ram', 'instances', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:39:57.253294 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-02a73792-6714-43c6-9916-c7667462b9bf tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Going to run 1 instances... {{(pid=117998) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:39:57.257353 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-02a73792-6714-43c6-9916-c7667462b9bf tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2b80b97a-06e6-4568-96bc-285acafff267',volume_size=None,volume_type=None)] {{(pid=117998) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:39:57.521526 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-02a73792-6714-43c6-9916-c7667462b9bf tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.553100 Jul 15 15:39:57.533556 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-1bfa2cd4-7559-4622-b36c-545e1985db4e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:57.534351 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-1bfa2cd4-7559-4622-b36c-545e1985db4e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:57.538381 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 468/930] 10.222.0.40 () {60 vars in 1146 bytes} [Fri Jul 15 15:39:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 1570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 15 15:39:57.600931 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1bfa2cd4-7559-4622-b36c-545e1985db4e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:57.609369 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-1bfa2cd4-7559-4622-b36c-545e1985db4e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1095 microversion: 2.1 time: 0.079906 Jul 15 15:39:57.619684 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 463/931] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:39:57 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1095 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:39:58.628327 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-51021e6e-48a6-442a-bde6-b2ef679dde4f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:58.629801 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-51021e6e-48a6-442a-bde6-b2ef679dde4f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:39:58.742456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-51021e6e-48a6-442a-bde6-b2ef679dde4f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:39:58.758344 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-51021e6e-48a6-442a-bde6-b2ef679dde4f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1095 microversion: 2.1 time: 0.134540 Jul 15 15:39:58.759748 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 469/932] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:39:58 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1095 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:39:59.789991 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-905b29b4-2f27-4b5f-9be2-afdf7890d6b8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:39:59.790981 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-905b29b4-2f27-4b5f-9be2-afdf7890d6b8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:00.040584 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-905b29b4-2f27-4b5f-9be2-afdf7890d6b8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:00.056887 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-905b29b4-2f27-4b5f-9be2-afdf7890d6b8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1095 microversion: 2.1 time: 0.279352 Jul 15 15:40:00.057750 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 464/933] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:39:59 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1095 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:01.076023 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7cf825a5-5e20-40a7-9794-51af794043cf tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:01.076921 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7cf825a5-5e20-40a7-9794-51af794043cf tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:01.090482 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7cf825a5-5e20-40a7-9794-51af794043cf tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:01.091126 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7cf825a5-5e20-40a7-9794-51af794043cf tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:01.092063 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7cf825a5-5e20-40a7-9794-51af794043cf tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:01.095382 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7cf825a5-5e20-40a7-9794-51af794043cf tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:01.230853 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7cf825a5-5e20-40a7-9794-51af794043cf tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:01.245588 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7cf825a5-5e20-40a7-9794-51af794043cf tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1145 microversion: 2.1 time: 0.174019 Jul 15 15:40:01.255611 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 470/934] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:01 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1145 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:02.272555 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-27ccee6f-0100-4c85-96a1-281c532c19da tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:02.275475 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-27ccee6f-0100-4c85-96a1-281c532c19da tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:02.300392 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-27ccee6f-0100-4c85-96a1-281c532c19da tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:02.305033 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-27ccee6f-0100-4c85-96a1-281c532c19da tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:02.306107 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-27ccee6f-0100-4c85-96a1-281c532c19da tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:02.311493 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-27ccee6f-0100-4c85-96a1-281c532c19da tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:02.590744 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-27ccee6f-0100-4c85-96a1-281c532c19da tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:02.606251 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-27ccee6f-0100-4c85-96a1-281c532c19da tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1201 microversion: 2.1 time: 0.338374 Jul 15 15:40:02.607428 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 465/935] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:02 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1201 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:03.623953 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-88a688b8-00bd-4ff5-a0e4-bdfacb920ade tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:03.624492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-88a688b8-00bd-4ff5-a0e4-bdfacb920ade tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:03.626916 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:40:03.641077 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-88a688b8-00bd-4ff5-a0e4-bdfacb920ade tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:03.641563 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-88a688b8-00bd-4ff5-a0e4-bdfacb920ade tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:03.642494 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-88a688b8-00bd-4ff5-a0e4-bdfacb920ade tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:03.645721 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-88a688b8-00bd-4ff5-a0e4-bdfacb920ade tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:03.652717 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:40:03.957465 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-88a688b8-00bd-4ff5-a0e4-bdfacb920ade tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:03.971015 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-88a688b8-00bd-4ff5-a0e4-bdfacb920ade tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1266 microversion: 2.1 time: 0.350504 Jul 15 15:40:03.972785 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 471/936] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:03 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1266 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:04.495577 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-c7aa6506-833e-49be-8be2-96408d56af60 req-2b4bc091-b6dc-4841-82ef-ef67a5273861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08079fe4-3136-4553-8307-59ab98073537", "tag": "f0be2353-05ff-4620-a1d0-be86ef2a4174"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:40:04.512127 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-c7aa6506-833e-49be-8be2-96408d56af60 req-2b4bc091-b6dc-4841-82ef-ef67a5273861 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:04.527290 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-c7aa6506-833e-49be-8be2-96408d56af60 req-2b4bc091-b6dc-4841-82ef-ef67a5273861 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:04.555929 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-c7aa6506-833e-49be-8be2-96408d56af60 req-2b4bc091-b6dc-4841-82ef-ef67a5273861 service nova] Creating event network-changed:f0be2353-05ff-4620-a1d0-be86ef2a4174 for instance 08079fe4-3136-4553-8307-59ab98073537 on hv-cinder-85001 Jul 15 15:40:04.572363 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-c7aa6506-833e-49be-8be2-96408d56af60 req-2b4bc091-b6dc-4841-82ef-ef67a5273861 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080468 Jul 15 15:40:04.573694 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 466/937] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:40:04.991595 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b0db7069-b763-4abc-83dc-603dcffdf487 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:04.993163 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b0db7069-b763-4abc-83dc-603dcffdf487 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:05.016265 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b0db7069-b763-4abc-83dc-603dcffdf487 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:05.016779 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b0db7069-b763-4abc-83dc-603dcffdf487 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:05.018030 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b0db7069-b763-4abc-83dc-603dcffdf487 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:05.019529 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b0db7069-b763-4abc-83dc-603dcffdf487 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:05.394053 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b0db7069-b763-4abc-83dc-603dcffdf487 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:05.406276 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b0db7069-b763-4abc-83dc-603dcffdf487 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1266 microversion: 2.1 time: 0.420238 Jul 15 15:40:05.408237 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 472/938] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:04 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1266 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:06.425576 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-6c1b09f2-800a-4fb3-8f19-cda9bbeffa51 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:06.427360 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-6c1b09f2-800a-4fb3-8f19-cda9bbeffa51 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:06.434343 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:40:06.442572 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6c1b09f2-800a-4fb3-8f19-cda9bbeffa51 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:06.455548 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6c1b09f2-800a-4fb3-8f19-cda9bbeffa51 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:06.457027 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6c1b09f2-800a-4fb3-8f19-cda9bbeffa51 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:06.457756 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6c1b09f2-800a-4fb3-8f19-cda9bbeffa51 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:06.493200 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=69 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:40:06.868678 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6c1b09f2-800a-4fb3-8f19-cda9bbeffa51 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:06.888093 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-6c1b09f2-800a-4fb3-8f19-cda9bbeffa51 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1266 microversion: 2.1 time: 0.467125 Jul 15 15:40:06.889455 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 467/939] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:06 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1266 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:07.915135 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-18aadcc0-72a4-45ee-b919-f94e099c51e3 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:07.916222 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-18aadcc0-72a4-45ee-b919-f94e099c51e3 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:07.920355 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:40:07.930574 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-18aadcc0-72a4-45ee-b919-f94e099c51e3 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:07.931368 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-18aadcc0-72a4-45ee-b919-f94e099c51e3 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:07.934575 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-18aadcc0-72a4-45ee-b919-f94e099c51e3 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:07.935322 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-18aadcc0-72a4-45ee-b919-f94e099c51e3 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:08.142354 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-18aadcc0-72a4-45ee-b919-f94e099c51e3 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:08.152804 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-18aadcc0-72a4-45ee-b919-f94e099c51e3 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1266 microversion: 2.1 time: 0.248471 Jul 15 15:40:08.153634 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 473/940] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:07 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:09.170058 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-28a0e777-bd9c-4fe9-af2b-17e9e5cb274e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:09.170680 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-28a0e777-bd9c-4fe9-af2b-17e9e5cb274e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:09.177445 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-28a0e777-bd9c-4fe9-af2b-17e9e5cb274e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:09.177932 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-28a0e777-bd9c-4fe9-af2b-17e9e5cb274e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:09.178994 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-28a0e777-bd9c-4fe9-af2b-17e9e5cb274e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:09.179793 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-28a0e777-bd9c-4fe9-af2b-17e9e5cb274e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:09.337171 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-28a0e777-bd9c-4fe9-af2b-17e9e5cb274e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:09.345487 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-28a0e777-bd9c-4fe9-af2b-17e9e5cb274e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1266 microversion: 2.1 time: 0.179396 Jul 15 15:40:09.346096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 468/941] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:09 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:10.363406 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-330baa61-3d09-4b95-ab0c-ba30e694978e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:10.364637 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-330baa61-3d09-4b95-ab0c-ba30e694978e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:10.370662 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=8 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:40:10.373084 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-330baa61-3d09-4b95-ab0c-ba30e694978e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:10.373533 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-330baa61-3d09-4b95-ab0c-ba30e694978e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:10.374317 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-330baa61-3d09-4b95-ab0c-ba30e694978e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:10.374772 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-330baa61-3d09-4b95-ab0c-ba30e694978e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:10.533484 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-330baa61-3d09-4b95-ab0c-ba30e694978e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:10.542100 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-330baa61-3d09-4b95-ab0c-ba30e694978e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1266 microversion: 2.1 time: 0.182378 Jul 15 15:40:10.543016 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 474/942] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:10 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:11.562914 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-a9812698-2a96-4f89-bb92-1b0647720c52 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:11.563537 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-a9812698-2a96-4f89-bb92-1b0647720c52 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:11.565400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=4 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:40:11.573060 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a9812698-2a96-4f89-bb92-1b0647720c52 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:11.573797 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a9812698-2a96-4f89-bb92-1b0647720c52 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:11.574789 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a9812698-2a96-4f89-bb92-1b0647720c52 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:11.575381 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a9812698-2a96-4f89-bb92-1b0647720c52 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:11.722436 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-a9812698-2a96-4f89-bb92-1b0647720c52 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:11.729950 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-a9812698-2a96-4f89-bb92-1b0647720c52 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1266 microversion: 2.1 time: 0.173031 Jul 15 15:40:11.730743 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 469/943] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:11 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:12.493961 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1327b88a-737c-46b8-bedb-7cf754de13a0 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Action: 'create', calling method: .version_select at 0x7fe3c66940d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1157789989", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEC3yaxcwIWpMl60psMZRAoiWYOnm9yoViPggjD1hMehBXBJsneomMYK3F5TLcvueiJXvuNsNPCNjJIxKw32gtqFDmz9ZRZuJcrj8/J8ry/ioFpQqLMerf6n0m8MjJV7+g=="}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:40:12.509951 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-1327b88a-737c-46b8-bedb-7cf754de13a0 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Getting quotas for project 25f10e8177434ab69a22f1270cd8d0db. Resources: {'key_pairs'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:40:12.514183 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-1327b88a-737c-46b8-bedb-7cf754de13a0 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Getting quotas for user 41e56871077745d18a51c2855a48cb7a and project 25f10e8177434ab69a22f1270cd8d0db. Resources: {'key_pairs'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:40:12.539419 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1327b88a-737c-46b8-bedb-7cf754de13a0 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.049790 Jul 15 15:40:12.540014 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 475/944] 10.222.0.40 () {60 vars in 1158 bytes} [Fri Jul 15 15:40:12 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:40:12.592403 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-79552738-9835-4877-a447-066f49fff39c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1512460342", "imageRef": "4350726d-c6c5-4fc7-85aa-338e4d1c1bbf", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1157789989", "networks": [{"uuid": "e3f5db16-ad6f-41e2-a922-6f61c2d56fe8"}]}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:40:12.643771 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.network.neutron [None req-79552738-9835-4877-a447-066f49fff39c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] validate_networks() for [('e3f5db16-ad6f-41e2-a922-6f61c2d56fe8', None, None, None, None, None)] {{(pid=117999) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:40:12.747245 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-dca23631-b1cf-4aaa-9c57-919e47e8b6c8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:12.747708 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-dca23631-b1cf-4aaa-9c57-919e47e8b6c8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:12.754641 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dca23631-b1cf-4aaa-9c57-919e47e8b6c8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:12.755082 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dca23631-b1cf-4aaa-9c57-919e47e8b6c8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:12.755833 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dca23631-b1cf-4aaa-9c57-919e47e8b6c8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:12.756470 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dca23631-b1cf-4aaa-9c57-919e47e8b6c8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:13.130460 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-dca23631-b1cf-4aaa-9c57-919e47e8b6c8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:13.138331 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-dca23631-b1cf-4aaa-9c57-919e47e8b6c8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1266 microversion: 2.1 time: 0.395204 Jul 15 15:40:13.138927 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 476/945] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:12 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1266 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:13.372541 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-79552738-9835-4877-a447-066f49fff39c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Flavor limits 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:40:13.372961 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-79552738-9835-4877-a447-066f49fff39c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Image limits 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:40:13.373435 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-79552738-9835-4877-a447-066f49fff39c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Flavor pref 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:40:13.373838 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-79552738-9835-4877-a447-066f49fff39c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Image pref 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:40:13.374255 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-79552738-9835-4877-a447-066f49fff39c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:40:13.384004 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-79552738-9835-4877-a447-066f49fff39c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:13.384448 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-79552738-9835-4877-a447-066f49fff39c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:13.385251 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-79552738-9835-4877-a447-066f49fff39c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:13.385682 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-79552738-9835-4877-a447-066f49fff39c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:13.403544 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-79552738-9835-4877-a447-066f49fff39c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Getting quotas for project 25f10e8177434ab69a22f1270cd8d0db. Resources: {'ram', 'instances', 'cores'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:40:13.408276 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-79552738-9835-4877-a447-066f49fff39c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Getting quotas for user 41e56871077745d18a51c2855a48cb7a and project 25f10e8177434ab69a22f1270cd8d0db. Resources: {'ram', 'instances', 'cores'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:40:13.420073 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-79552738-9835-4877-a447-066f49fff39c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Going to run 1 instances... {{(pid=117999) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:40:13.422250 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-79552738-9835-4877-a447-066f49fff39c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4350726d-c6c5-4fc7-85aa-338e4d1c1bbf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117999) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:40:13.468903 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-79552738-9835-4877-a447-066f49fff39c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.880335 Jul 15 15:40:13.469727 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 470/946] 10.222.0.40 () {60 vars in 1146 bytes} [Fri Jul 15 15:40:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 15:40:13.479831 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f1b7e38b-a2c0-4f60-b536-8f72d64a80d5 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:13.480508 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f1b7e38b-a2c0-4f60-b536-8f72d64a80d5 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:13.544096 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f1b7e38b-a2c0-4f60-b536-8f72d64a80d5 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:13.552843 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f1b7e38b-a2c0-4f60-b536-8f72d64a80d5 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1259 microversion: 2.1 time: 0.077073 Jul 15 15:40:13.553413 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 477/947] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:13 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1259 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:14.156009 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-be6c4a7f-7535-4519-ae18-c49ee0894a79 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:14.156621 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-be6c4a7f-7535-4519-ae18-c49ee0894a79 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:14.163297 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-be6c4a7f-7535-4519-ae18-c49ee0894a79 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:14.163711 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-be6c4a7f-7535-4519-ae18-c49ee0894a79 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:14.164494 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-be6c4a7f-7535-4519-ae18-c49ee0894a79 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:14.164923 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-be6c4a7f-7535-4519-ae18-c49ee0894a79 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:14.305479 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-be6c4a7f-7535-4519-ae18-c49ee0894a79 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:14.313387 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-be6c4a7f-7535-4519-ae18-c49ee0894a79 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1266 microversion: 2.1 time: 0.161847 Jul 15 15:40:14.313947 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 471/948] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:14 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:14.572096 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-64f09b0e-4df3-4ff6-a2a1-721eef52c628 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:14.572785 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-64f09b0e-4df3-4ff6-a2a1-721eef52c628 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:14.581156 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-64f09b0e-4df3-4ff6-a2a1-721eef52c628 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:14.581612 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-64f09b0e-4df3-4ff6-a2a1-721eef52c628 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:14.582793 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-64f09b0e-4df3-4ff6-a2a1-721eef52c628 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:14.583243 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-64f09b0e-4df3-4ff6-a2a1-721eef52c628 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:14.673884 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-64f09b0e-4df3-4ff6-a2a1-721eef52c628 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:14.683326 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-64f09b0e-4df3-4ff6-a2a1-721eef52c628 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1317 microversion: 2.1 time: 0.116981 Jul 15 15:40:14.683994 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 478/949] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:14 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1317 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:15.330850 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-93cfc862-d1ee-4abd-926b-9f1c9f3ff1d3 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:15.332232 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-93cfc862-d1ee-4abd-926b-9f1c9f3ff1d3 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:15.347669 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-93cfc862-d1ee-4abd-926b-9f1c9f3ff1d3 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:15.349540 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-93cfc862-d1ee-4abd-926b-9f1c9f3ff1d3 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:15.353484 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-93cfc862-d1ee-4abd-926b-9f1c9f3ff1d3 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:15.354251 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-93cfc862-d1ee-4abd-926b-9f1c9f3ff1d3 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:15.592515 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-93cfc862-d1ee-4abd-926b-9f1c9f3ff1d3 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:15.601568 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-93cfc862-d1ee-4abd-926b-9f1c9f3ff1d3 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1266 microversion: 2.1 time: 0.274397 Jul 15 15:40:15.604032 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 472/950] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:15 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:15.702299 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1d5b075c-57dd-417a-a9e7-1f7c9f3ddcee tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:15.703701 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1d5b075c-57dd-417a-a9e7-1f7c9f3ddcee tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:15.719202 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1d5b075c-57dd-417a-a9e7-1f7c9f3ddcee tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:15.719641 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1d5b075c-57dd-417a-a9e7-1f7c9f3ddcee tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:15.720438 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1d5b075c-57dd-417a-a9e7-1f7c9f3ddcee tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:15.720854 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1d5b075c-57dd-417a-a9e7-1f7c9f3ddcee tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:15.864713 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1d5b075c-57dd-417a-a9e7-1f7c9f3ddcee tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:15.873960 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1d5b075c-57dd-417a-a9e7-1f7c9f3ddcee tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1359 microversion: 2.1 time: 0.176214 Jul 15 15:40:15.874554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 479/951] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:15 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:16.626407 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-808c3036-14ca-4100-afb3-69741078f9fe tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:16.627197 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-808c3036-14ca-4100-afb3-69741078f9fe tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:16.633860 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-808c3036-14ca-4100-afb3-69741078f9fe tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:16.634734 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-808c3036-14ca-4100-afb3-69741078f9fe tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:16.635682 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-808c3036-14ca-4100-afb3-69741078f9fe tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:16.636309 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-808c3036-14ca-4100-afb3-69741078f9fe tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:16.832759 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-808c3036-14ca-4100-afb3-69741078f9fe tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:16.844547 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-e6893ed8-a0b6-4d6a-8706-468748bc8339 req-dcda3cf5-1b18-417e-ade8-381bb27dcaa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08079fe4-3136-4553-8307-59ab98073537", "name": "network-vif-plugged", "status": "completed", "tag": "f0be2353-05ff-4620-a1d0-be86ef2a4174"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:40:16.846930 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-808c3036-14ca-4100-afb3-69741078f9fe tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1266 microversion: 2.1 time: 0.225244 Jul 15 15:40:16.848487 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 473/952] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:16 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:16.859362 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-e6893ed8-a0b6-4d6a-8706-468748bc8339 req-dcda3cf5-1b18-417e-ade8-381bb27dcaa1 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:16.860139 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-e6893ed8-a0b6-4d6a-8706-468748bc8339 req-dcda3cf5-1b18-417e-ade8-381bb27dcaa1 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:16.872964 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-e6893ed8-a0b6-4d6a-8706-468748bc8339 req-dcda3cf5-1b18-417e-ade8-381bb27dcaa1 service nova] Creating event network-vif-plugged:f0be2353-05ff-4620-a1d0-be86ef2a4174 for instance 08079fe4-3136-4553-8307-59ab98073537 on hv-cinder-85001 Jul 15 15:40:16.879579 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-e6893ed8-a0b6-4d6a-8706-468748bc8339 req-dcda3cf5-1b18-417e-ade8-381bb27dcaa1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038811 Jul 15 15:40:16.880842 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 480/953] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:40:16.891683 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3752641a-8d5c-4e33-96e8-f7c411b4e63c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:16.892575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-3752641a-8d5c-4e33-96e8-f7c411b4e63c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:16.899980 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3752641a-8d5c-4e33-96e8-f7c411b4e63c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:16.900419 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3752641a-8d5c-4e33-96e8-f7c411b4e63c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:16.901232 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3752641a-8d5c-4e33-96e8-f7c411b4e63c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:16.901675 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3752641a-8d5c-4e33-96e8-f7c411b4e63c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:17.068327 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3752641a-8d5c-4e33-96e8-f7c411b4e63c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:17.077477 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-3752641a-8d5c-4e33-96e8-f7c411b4e63c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1359 microversion: 2.1 time: 0.190304 Jul 15 15:40:17.078066 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 474/954] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:16 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:17.866258 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c77a712c-d7ef-4e88-b0c5-2ee13386383e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:17.867726 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-c77a712c-d7ef-4e88-b0c5-2ee13386383e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:17.874655 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c77a712c-d7ef-4e88-b0c5-2ee13386383e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:17.875372 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c77a712c-d7ef-4e88-b0c5-2ee13386383e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:17.876124 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c77a712c-d7ef-4e88-b0c5-2ee13386383e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:17.876571 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c77a712c-d7ef-4e88-b0c5-2ee13386383e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:18.019907 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c77a712c-d7ef-4e88-b0c5-2ee13386383e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:18.027838 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-c77a712c-d7ef-4e88-b0c5-2ee13386383e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1266 microversion: 2.1 time: 0.166288 Jul 15 15:40:18.028641 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 481/955] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:17 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:18.095057 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-27b2b77a-cd42-4b13-97db-fa0986c00d90 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:18.095642 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-27b2b77a-cd42-4b13-97db-fa0986c00d90 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:18.103157 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-27b2b77a-cd42-4b13-97db-fa0986c00d90 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:18.103876 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-27b2b77a-cd42-4b13-97db-fa0986c00d90 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:18.104817 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-27b2b77a-cd42-4b13-97db-fa0986c00d90 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:18.105395 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-27b2b77a-cd42-4b13-97db-fa0986c00d90 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:18.239197 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-27b2b77a-cd42-4b13-97db-fa0986c00d90 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:18.247483 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-27b2b77a-cd42-4b13-97db-fa0986c00d90 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1359 microversion: 2.1 time: 0.156164 Jul 15 15:40:18.248032 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 475/956] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:18 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:19.045338 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-36b69904-be87-43c4-9174-4bd4ba100cfe tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:19.045916 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-36b69904-be87-43c4-9174-4bd4ba100cfe tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:19.053178 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-36b69904-be87-43c4-9174-4bd4ba100cfe tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:19.053624 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-36b69904-be87-43c4-9174-4bd4ba100cfe tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:19.054370 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-36b69904-be87-43c4-9174-4bd4ba100cfe tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:19.055569 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-36b69904-be87-43c4-9174-4bd4ba100cfe tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:19.197856 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-36b69904-be87-43c4-9174-4bd4ba100cfe tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:19.205767 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-36b69904-be87-43c4-9174-4bd4ba100cfe tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1266 microversion: 2.1 time: 0.164360 Jul 15 15:40:19.206338 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 482/957] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:19 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:19.264763 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-93e6c0d4-ea02-44ba-b219-10cdab97fd5a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:19.265401 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-93e6c0d4-ea02-44ba-b219-10cdab97fd5a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:19.272555 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-93e6c0d4-ea02-44ba-b219-10cdab97fd5a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:19.273002 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-93e6c0d4-ea02-44ba-b219-10cdab97fd5a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:19.274481 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-93e6c0d4-ea02-44ba-b219-10cdab97fd5a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:19.274938 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-93e6c0d4-ea02-44ba-b219-10cdab97fd5a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:19.437328 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-93e6c0d4-ea02-44ba-b219-10cdab97fd5a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:19.444888 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-93e6c0d4-ea02-44ba-b219-10cdab97fd5a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1359 microversion: 2.1 time: 0.184114 Jul 15 15:40:19.445879 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 476/958] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:19 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:20.223412 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9afe35df-2a93-4674-89df-6f1831de1160 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:20.224287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9afe35df-2a93-4674-89df-6f1831de1160 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:20.236466 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9afe35df-2a93-4674-89df-6f1831de1160 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:20.237219 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9afe35df-2a93-4674-89df-6f1831de1160 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:20.238569 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9afe35df-2a93-4674-89df-6f1831de1160 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:20.239315 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9afe35df-2a93-4674-89df-6f1831de1160 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:20.384817 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9afe35df-2a93-4674-89df-6f1831de1160 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:20.392350 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9afe35df-2a93-4674-89df-6f1831de1160 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1266 microversion: 2.1 time: 0.172943 Jul 15 15:40:20.392905 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 483/959] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:20 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:20.468583 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-b6d1e8e9-4708-484a-8826-90393a320aa6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:20.469435 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-b6d1e8e9-4708-484a-8826-90393a320aa6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:20.477900 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b6d1e8e9-4708-484a-8826-90393a320aa6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:20.478326 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b6d1e8e9-4708-484a-8826-90393a320aa6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:20.479142 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b6d1e8e9-4708-484a-8826-90393a320aa6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:20.480131 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b6d1e8e9-4708-484a-8826-90393a320aa6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:20.771027 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b6d1e8e9-4708-484a-8826-90393a320aa6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:20.779301 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-b6d1e8e9-4708-484a-8826-90393a320aa6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1359 microversion: 2.1 time: 0.314645 Jul 15 15:40:20.779877 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 477/960] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:20 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1359 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:21.409770 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7e5e2a62-a852-4013-99a2-6f1a64e682b6 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:21.411154 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7e5e2a62-a852-4013-99a2-6f1a64e682b6 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:21.418458 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7e5e2a62-a852-4013-99a2-6f1a64e682b6 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:21.418937 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7e5e2a62-a852-4013-99a2-6f1a64e682b6 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:21.419683 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7e5e2a62-a852-4013-99a2-6f1a64e682b6 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:21.420108 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7e5e2a62-a852-4013-99a2-6f1a64e682b6 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:21.559971 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7e5e2a62-a852-4013-99a2-6f1a64e682b6 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:21.568200 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7e5e2a62-a852-4013-99a2-6f1a64e682b6 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1266 microversion: 2.1 time: 0.162652 Jul 15 15:40:21.569005 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 484/961] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:21 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:21.796775 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-e97406ec-9c55-4182-b807-d54f55f35a4f tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:21.798092 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-e97406ec-9c55-4182-b807-d54f55f35a4f tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:21.805592 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e97406ec-9c55-4182-b807-d54f55f35a4f tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:21.806345 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e97406ec-9c55-4182-b807-d54f55f35a4f tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:21.807378 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e97406ec-9c55-4182-b807-d54f55f35a4f tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:21.807810 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e97406ec-9c55-4182-b807-d54f55f35a4f tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:21.957566 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e97406ec-9c55-4182-b807-d54f55f35a4f tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:21.966270 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-e97406ec-9c55-4182-b807-d54f55f35a4f tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1359 microversion: 2.1 time: 0.173307 Jul 15 15:40:21.967066 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 478/962] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:21 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:22.588578 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3445f326-2742-4d29-9ecf-92deb1a6679e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:22.589464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3445f326-2742-4d29-9ecf-92deb1a6679e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:22.596364 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3445f326-2742-4d29-9ecf-92deb1a6679e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:22.596894 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3445f326-2742-4d29-9ecf-92deb1a6679e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:22.597742 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3445f326-2742-4d29-9ecf-92deb1a6679e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:22.598239 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3445f326-2742-4d29-9ecf-92deb1a6679e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:22.756442 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3445f326-2742-4d29-9ecf-92deb1a6679e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:22.767480 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3445f326-2742-4d29-9ecf-92deb1a6679e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1266 microversion: 2.1 time: 0.185031 Jul 15 15:40:22.768105 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 485/963] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:22 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:22.992688 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-fa10ccd7-692d-4bf2-85bc-3310bc8ebe3c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:22.994978 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-fa10ccd7-692d-4bf2-85bc-3310bc8ebe3c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:23.007399 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fa10ccd7-692d-4bf2-85bc-3310bc8ebe3c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:23.008780 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fa10ccd7-692d-4bf2-85bc-3310bc8ebe3c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:23.011502 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fa10ccd7-692d-4bf2-85bc-3310bc8ebe3c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:23.012842 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fa10ccd7-692d-4bf2-85bc-3310bc8ebe3c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:23.186602 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-fa10ccd7-692d-4bf2-85bc-3310bc8ebe3c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:23.195408 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-fa10ccd7-692d-4bf2-85bc-3310bc8ebe3c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1359 microversion: 2.1 time: 0.211463 Jul 15 15:40:23.205965 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 479/964] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:22 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:23.785248 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9ff70c53-757a-491a-90a2-bdb7391c7816 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:23.786386 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9ff70c53-757a-491a-90a2-bdb7391c7816 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:23.788340 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=6 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:40:23.794864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9ff70c53-757a-491a-90a2-bdb7391c7816 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:23.795610 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9ff70c53-757a-491a-90a2-bdb7391c7816 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:23.796578 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9ff70c53-757a-491a-90a2-bdb7391c7816 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:23.797190 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9ff70c53-757a-491a-90a2-bdb7391c7816 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:23.959038 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9ff70c53-757a-491a-90a2-bdb7391c7816 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:23.968637 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9ff70c53-757a-491a-90a2-bdb7391c7816 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1266 microversion: 2.1 time: 0.187355 Jul 15 15:40:23.969470 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 486/965] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:23 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:24.213173 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-4f7dd8df-444b-4024-b703-fac036202f4e tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:24.213851 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-4f7dd8df-444b-4024-b703-fac036202f4e tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:24.215659 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=2 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:40:24.216350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=6 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:40:24.222548 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4f7dd8df-444b-4024-b703-fac036202f4e tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:24.223230 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4f7dd8df-444b-4024-b703-fac036202f4e tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:24.223782 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4f7dd8df-444b-4024-b703-fac036202f4e tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:24.224213 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4f7dd8df-444b-4024-b703-fac036202f4e tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:24.359276 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-4f7dd8df-444b-4024-b703-fac036202f4e tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:24.367336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-4f7dd8df-444b-4024-b703-fac036202f4e tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1359 microversion: 2.1 time: 0.158474 Jul 15 15:40:24.368240 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 480/966] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:24 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:24.985764 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9a4bf06b-c248-4479-aec6-62dd7e26e0c5 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:24.986379 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9a4bf06b-c248-4479-aec6-62dd7e26e0c5 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:24.994775 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9a4bf06b-c248-4479-aec6-62dd7e26e0c5 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:24.994775 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9a4bf06b-c248-4479-aec6-62dd7e26e0c5 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:24.995473 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9a4bf06b-c248-4479-aec6-62dd7e26e0c5 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:24.995906 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9a4bf06b-c248-4479-aec6-62dd7e26e0c5 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:25.141133 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9a4bf06b-c248-4479-aec6-62dd7e26e0c5 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:25.153747 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9a4bf06b-c248-4479-aec6-62dd7e26e0c5 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1266 microversion: 2.1 time: 0.171620 Jul 15 15:40:25.160927 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 487/967] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:24 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:25.386044 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-696e69c6-20de-4a59-86bc-e3375228bfed tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:25.386663 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-696e69c6-20de-4a59-86bc-e3375228bfed tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:25.394079 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-696e69c6-20de-4a59-86bc-e3375228bfed tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:25.394551 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-696e69c6-20de-4a59-86bc-e3375228bfed tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:25.395330 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-696e69c6-20de-4a59-86bc-e3375228bfed tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:25.395761 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-696e69c6-20de-4a59-86bc-e3375228bfed tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:25.535772 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-696e69c6-20de-4a59-86bc-e3375228bfed tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:25.543596 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-696e69c6-20de-4a59-86bc-e3375228bfed tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1359 microversion: 2.1 time: 0.162430 Jul 15 15:40:25.544160 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 481/968] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:25 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:26.176276 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-fceb1f26-58b2-4eea-816b-2f405805b78e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:26.176905 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-fceb1f26-58b2-4eea-816b-2f405805b78e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:26.184621 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fceb1f26-58b2-4eea-816b-2f405805b78e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:26.185073 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fceb1f26-58b2-4eea-816b-2f405805b78e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:26.186505 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fceb1f26-58b2-4eea-816b-2f405805b78e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:26.186505 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fceb1f26-58b2-4eea-816b-2f405805b78e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:26.328393 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-fceb1f26-58b2-4eea-816b-2f405805b78e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:26.336014 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-fceb1f26-58b2-4eea-816b-2f405805b78e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1266 microversion: 2.1 time: 0.166442 Jul 15 15:40:26.336580 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 488/969] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:26 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:26.562135 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-d5e6a12d-a140-4f2d-8da6-146773f00675 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:26.562800 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-d5e6a12d-a140-4f2d-8da6-146773f00675 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:26.569903 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d5e6a12d-a140-4f2d-8da6-146773f00675 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:26.570351 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d5e6a12d-a140-4f2d-8da6-146773f00675 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:26.571149 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d5e6a12d-a140-4f2d-8da6-146773f00675 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:26.571764 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d5e6a12d-a140-4f2d-8da6-146773f00675 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:26.715013 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-d5e6a12d-a140-4f2d-8da6-146773f00675 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:26.723934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-d5e6a12d-a140-4f2d-8da6-146773f00675 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1359 microversion: 2.1 time: 0.166218 Jul 15 15:40:26.724595 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 482/970] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:26 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:27.355310 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4743cbe3-da7c-48cb-9612-fde2ab804483 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:27.355940 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-4743cbe3-da7c-48cb-9612-fde2ab804483 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:27.363099 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4743cbe3-da7c-48cb-9612-fde2ab804483 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:27.363536 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4743cbe3-da7c-48cb-9612-fde2ab804483 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:27.364304 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4743cbe3-da7c-48cb-9612-fde2ab804483 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:27.364727 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4743cbe3-da7c-48cb-9612-fde2ab804483 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:27.512563 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-4743cbe3-da7c-48cb-9612-fde2ab804483 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:27.522249 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4743cbe3-da7c-48cb-9612-fde2ab804483 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1266 microversion: 2.1 time: 0.171717 Jul 15 15:40:27.523274 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 489/971] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:27 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:27.746197 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-4ec9ac7d-92a5-4392-8ed5-4bc1807491f6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:27.747490 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-4ec9ac7d-92a5-4392-8ed5-4bc1807491f6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:27.760513 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4ec9ac7d-92a5-4392-8ed5-4bc1807491f6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:27.761359 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4ec9ac7d-92a5-4392-8ed5-4bc1807491f6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:27.762771 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4ec9ac7d-92a5-4392-8ed5-4bc1807491f6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:27.763516 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4ec9ac7d-92a5-4392-8ed5-4bc1807491f6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:28.064927 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-4ec9ac7d-92a5-4392-8ed5-4bc1807491f6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:28.074812 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-4ec9ac7d-92a5-4392-8ed5-4bc1807491f6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1359 microversion: 2.1 time: 0.336763 Jul 15 15:40:28.075409 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 483/972] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:27 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1359 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:28.544500 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b4db6199-9d66-4e73-88ba-afc1f329e83c tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:28.545527 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b4db6199-9d66-4e73-88ba-afc1f329e83c tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:28.556739 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b4db6199-9d66-4e73-88ba-afc1f329e83c tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:28.556739 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b4db6199-9d66-4e73-88ba-afc1f329e83c tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:28.557056 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b4db6199-9d66-4e73-88ba-afc1f329e83c tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:28.557437 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b4db6199-9d66-4e73-88ba-afc1f329e83c tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:28.567366 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-2857c9b8-2429-4d04-abe0-0d0e24057992 req-22319bb4-e69a-45f5-b572-7d33113f1eaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c767fdb-5253-437d-8856-2c5a8934d8ca", "tag": "1fa2eb43-8651-449a-adde-4193c18db06c"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:40:28.584898 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-2857c9b8-2429-4d04-abe0-0d0e24057992 req-22319bb4-e69a-45f5-b572-7d33113f1eaf service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:28.585448 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-2857c9b8-2429-4d04-abe0-0d0e24057992 req-22319bb4-e69a-45f5-b572-7d33113f1eaf service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:28.586898 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=100 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:40:28.605593 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-2857c9b8-2429-4d04-abe0-0d0e24057992 req-22319bb4-e69a-45f5-b572-7d33113f1eaf service nova] Creating event network-changed:1fa2eb43-8651-449a-adde-4193c18db06c for instance 3c767fdb-5253-437d-8856-2c5a8934d8ca on hv-cinder-85001 Jul 15 15:40:28.611952 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-2857c9b8-2429-4d04-abe0-0d0e24057992 req-22319bb4-e69a-45f5-b572-7d33113f1eaf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051855 Jul 15 15:40:28.612664 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 484/973] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:40:28.723720 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b4db6199-9d66-4e73-88ba-afc1f329e83c tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:28.731654 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b4db6199-9d66-4e73-88ba-afc1f329e83c tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1266 microversion: 2.1 time: 0.191521 Jul 15 15:40:28.732267 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 490/974] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:28 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:29.094872 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-849f1d37-0fac-4291-958d-2bd255318f2a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:29.095593 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-849f1d37-0fac-4291-958d-2bd255318f2a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:29.102127 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-849f1d37-0fac-4291-958d-2bd255318f2a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:29.102554 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-849f1d37-0fac-4291-958d-2bd255318f2a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:29.103581 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-849f1d37-0fac-4291-958d-2bd255318f2a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:29.104178 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-849f1d37-0fac-4291-958d-2bd255318f2a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:29.107135 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=100 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:40:29.393665 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-849f1d37-0fac-4291-958d-2bd255318f2a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:29.401402 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-849f1d37-0fac-4291-958d-2bd255318f2a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1359 microversion: 2.1 time: 0.311348 Jul 15 15:40:29.402080 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 485/975] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:29 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1359 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:29.753262 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4f3355fe-37a7-4a1b-931b-22adee0b7f2e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:29.754376 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-4f3355fe-37a7-4a1b-931b-22adee0b7f2e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:29.765874 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4f3355fe-37a7-4a1b-931b-22adee0b7f2e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:29.766667 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4f3355fe-37a7-4a1b-931b-22adee0b7f2e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:29.768016 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4f3355fe-37a7-4a1b-931b-22adee0b7f2e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:29.768792 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4f3355fe-37a7-4a1b-931b-22adee0b7f2e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:30.322765 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-4f3355fe-37a7-4a1b-931b-22adee0b7f2e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:30.335137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4f3355fe-37a7-4a1b-931b-22adee0b7f2e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1266 microversion: 2.1 time: 0.588701 Jul 15 15:40:30.335767 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 491/976] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:29 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1266 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:30.419226 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-b6ef0e48-2dd2-43f1-8e96-57869be0a4ba tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:30.419818 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-b6ef0e48-2dd2-43f1-8e96-57869be0a4ba tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:30.427030 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b6ef0e48-2dd2-43f1-8e96-57869be0a4ba tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:30.427472 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b6ef0e48-2dd2-43f1-8e96-57869be0a4ba tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:30.428237 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b6ef0e48-2dd2-43f1-8e96-57869be0a4ba tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:30.428677 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b6ef0e48-2dd2-43f1-8e96-57869be0a4ba tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:30.568736 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b6ef0e48-2dd2-43f1-8e96-57869be0a4ba tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:30.576485 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-b6ef0e48-2dd2-43f1-8e96-57869be0a4ba tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1359 microversion: 2.1 time: 0.161161 Jul 15 15:40:30.584398 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 486/977] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:30 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:31.357602 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0e5ed9d1-82bd-451b-afed-e9eb6fc96023 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:31.358751 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-0e5ed9d1-82bd-451b-afed-e9eb6fc96023 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:31.368964 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0e5ed9d1-82bd-451b-afed-e9eb6fc96023 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:31.370682 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0e5ed9d1-82bd-451b-afed-e9eb6fc96023 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:31.371552 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0e5ed9d1-82bd-451b-afed-e9eb6fc96023 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:31.372131 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0e5ed9d1-82bd-451b-afed-e9eb6fc96023 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:31.521592 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0e5ed9d1-82bd-451b-afed-e9eb6fc96023 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:31.530249 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-0e5ed9d1-82bd-451b-afed-e9eb6fc96023 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1453 microversion: 2.1 time: 0.180176 Jul 15 15:40:31.530873 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 492/978] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:31 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1453 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:31.547423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-eb383a0b-33bc-4aab-8785-985500c0a0a4 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:31.548062 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-eb383a0b-33bc-4aab-8785-985500c0a0a4 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:31.554748 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-eb383a0b-33bc-4aab-8785-985500c0a0a4 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:31.555192 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-eb383a0b-33bc-4aab-8785-985500c0a0a4 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:31.555947 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-eb383a0b-33bc-4aab-8785-985500c0a0a4 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:31.556508 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-eb383a0b-33bc-4aab-8785-985500c0a0a4 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:31.594547 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-bac5fde8-1a1d-4d0c-a59d-d6d398c3b45a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:31.595211 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-bac5fde8-1a1d-4d0c-a59d-d6d398c3b45a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:31.605082 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bac5fde8-1a1d-4d0c-a59d-d6d398c3b45a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:31.605522 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bac5fde8-1a1d-4d0c-a59d-d6d398c3b45a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:31.606315 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bac5fde8-1a1d-4d0c-a59d-d6d398c3b45a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:31.606797 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bac5fde8-1a1d-4d0c-a59d-d6d398c3b45a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:31.748314 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-eb383a0b-33bc-4aab-8785-985500c0a0a4 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:31.756786 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-eb383a0b-33bc-4aab-8785-985500c0a0a4 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1453 microversion: 2.1 time: 0.213403 Jul 15 15:40:31.757623 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 487/979] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:31 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1453 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:40:31.790954 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-bac5fde8-1a1d-4d0c-a59d-d6d398c3b45a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:31.798852 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-bac5fde8-1a1d-4d0c-a59d-d6d398c3b45a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1359 microversion: 2.1 time: 0.208507 Jul 15 15:40:31.799644 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 493/980] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:31 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1359 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:40:32.817312 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-558ea074-7619-4e62-a479-2e36bcdfad52 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:32.818116 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-558ea074-7619-4e62-a479-2e36bcdfad52 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:32.825417 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-558ea074-7619-4e62-a479-2e36bcdfad52 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:32.825868 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-558ea074-7619-4e62-a479-2e36bcdfad52 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:32.826688 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-558ea074-7619-4e62-a479-2e36bcdfad52 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:32.827115 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-558ea074-7619-4e62-a479-2e36bcdfad52 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:33.004590 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-558ea074-7619-4e62-a479-2e36bcdfad52 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:33.019122 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-558ea074-7619-4e62-a479-2e36bcdfad52 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1359 microversion: 2.1 time: 0.205577 Jul 15 15:40:33.020453 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 488/981] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:32 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:33.569886 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-7e87fa69-af52-4b44-ae44-3e27bb79bb7d req-32346eee-3014-4e1c-b022-bd98c5358676 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08079fe4-3136-4553-8307-59ab98073537", "tag": "f0be2353-05ff-4620-a1d0-be86ef2a4174"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:40:33.579580 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-7e87fa69-af52-4b44-ae44-3e27bb79bb7d req-32346eee-3014-4e1c-b022-bd98c5358676 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:33.580104 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-7e87fa69-af52-4b44-ae44-3e27bb79bb7d req-32346eee-3014-4e1c-b022-bd98c5358676 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:33.592625 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-7e87fa69-af52-4b44-ae44-3e27bb79bb7d req-32346eee-3014-4e1c-b022-bd98c5358676 service nova] Creating event network-changed:f0be2353-05ff-4620-a1d0-be86ef2a4174 for instance 08079fe4-3136-4553-8307-59ab98073537 on hv-cinder-85001 Jul 15 15:40:33.597931 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-7e87fa69-af52-4b44-ae44-3e27bb79bb7d req-32346eee-3014-4e1c-b022-bd98c5358676 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032854 Jul 15 15:40:33.598491 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 494/982] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:40:34.040520 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-0c82063d-e94d-4b11-bb6c-1464f319b34d tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:34.042729 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-0c82063d-e94d-4b11-bb6c-1464f319b34d tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:34.049226 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0c82063d-e94d-4b11-bb6c-1464f319b34d tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:34.049652 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0c82063d-e94d-4b11-bb6c-1464f319b34d tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:34.050661 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0c82063d-e94d-4b11-bb6c-1464f319b34d tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:34.051345 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0c82063d-e94d-4b11-bb6c-1464f319b34d tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:34.307425 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-0c82063d-e94d-4b11-bb6c-1464f319b34d tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:34.316138 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-0c82063d-e94d-4b11-bb6c-1464f319b34d tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1359 microversion: 2.1 time: 0.279434 Jul 15 15:40:34.316751 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 489/983] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:34 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1359 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:35.335008 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-40e1e786-acb1-4f81-9a06-9804214e66fe tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:35.335744 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-40e1e786-acb1-4f81-9a06-9804214e66fe tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:35.337772 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:40:35.343639 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-40e1e786-acb1-4f81-9a06-9804214e66fe tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:35.344076 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-40e1e786-acb1-4f81-9a06-9804214e66fe tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:35.344843 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-40e1e786-acb1-4f81-9a06-9804214e66fe tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:35.345265 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-40e1e786-acb1-4f81-9a06-9804214e66fe tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:35.484665 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-40e1e786-acb1-4f81-9a06-9804214e66fe tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:35.492627 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-40e1e786-acb1-4f81-9a06-9804214e66fe tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1359 microversion: 2.1 time: 0.162457 Jul 15 15:40:35.493226 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 495/984] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:35 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:36.510428 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-33b27d16-dd13-43a3-a3c0-c5388362c6c6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:36.511198 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-33b27d16-dd13-43a3-a3c0-c5388362c6c6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:36.513493 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:40:36.519061 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-33b27d16-dd13-43a3-a3c0-c5388362c6c6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:36.519553 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-33b27d16-dd13-43a3-a3c0-c5388362c6c6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:36.520311 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-33b27d16-dd13-43a3-a3c0-c5388362c6c6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:36.520804 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-33b27d16-dd13-43a3-a3c0-c5388362c6c6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:36.670546 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-33b27d16-dd13-43a3-a3c0-c5388362c6c6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:36.678322 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-33b27d16-dd13-43a3-a3c0-c5388362c6c6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1359 microversion: 2.1 time: 0.172139 Jul 15 15:40:36.678916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 490/985] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:36 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:36.878217 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-c17ab949-4c31-40b7-aa61-8b5e1c3f8c95 req-5583b117-1bf0-47ea-ba6f-ea3600b59301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c767fdb-5253-437d-8856-2c5a8934d8ca", "name": "network-vif-plugged", "status": "completed", "tag": "1fa2eb43-8651-449a-adde-4193c18db06c"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:40:36.889488 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-c17ab949-4c31-40b7-aa61-8b5e1c3f8c95 req-5583b117-1bf0-47ea-ba6f-ea3600b59301 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:36.890306 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-c17ab949-4c31-40b7-aa61-8b5e1c3f8c95 req-5583b117-1bf0-47ea-ba6f-ea3600b59301 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:36.905728 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-c17ab949-4c31-40b7-aa61-8b5e1c3f8c95 req-5583b117-1bf0-47ea-ba6f-ea3600b59301 service nova] Creating event network-vif-plugged:1fa2eb43-8651-449a-adde-4193c18db06c for instance 3c767fdb-5253-437d-8856-2c5a8934d8ca on hv-cinder-85001 Jul 15 15:40:36.911550 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-c17ab949-4c31-40b7-aa61-8b5e1c3f8c95 req-5583b117-1bf0-47ea-ba6f-ea3600b59301 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037991 Jul 15 15:40:36.912340 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 496/986] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:40:37.696683 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-52f1625b-359f-4169-8e68-56ed07700377 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:37.697310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-52f1625b-359f-4169-8e68-56ed07700377 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:37.704036 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-52f1625b-359f-4169-8e68-56ed07700377 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:37.704471 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-52f1625b-359f-4169-8e68-56ed07700377 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:37.705218 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-52f1625b-359f-4169-8e68-56ed07700377 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:37.705637 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-52f1625b-359f-4169-8e68-56ed07700377 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:37.843516 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-52f1625b-359f-4169-8e68-56ed07700377 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:37.852585 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-52f1625b-359f-4169-8e68-56ed07700377 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1359 microversion: 2.1 time: 0.159989 Jul 15 15:40:37.853140 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 491/987] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:37 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:38.871754 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f882c594-aabb-4a6d-b8fa-74ea74a68e26 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:38.872484 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f882c594-aabb-4a6d-b8fa-74ea74a68e26 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:38.879595 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f882c594-aabb-4a6d-b8fa-74ea74a68e26 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:38.880038 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f882c594-aabb-4a6d-b8fa-74ea74a68e26 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:38.881122 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f882c594-aabb-4a6d-b8fa-74ea74a68e26 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:38.881468 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f882c594-aabb-4a6d-b8fa-74ea74a68e26 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:39.044794 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f882c594-aabb-4a6d-b8fa-74ea74a68e26 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:39.055572 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f882c594-aabb-4a6d-b8fa-74ea74a68e26 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1548 microversion: 2.1 time: 0.188774 Jul 15 15:40:39.056513 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 497/988] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:38 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1548 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:39.081798 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-6c93c1b4-fa0c-4ef9-8f5c-ccb7a0abb62a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:39.082738 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-6c93c1b4-fa0c-4ef9-8f5c-ccb7a0abb62a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:39.090287 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6c93c1b4-fa0c-4ef9-8f5c-ccb7a0abb62a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:39.090780 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6c93c1b4-fa0c-4ef9-8f5c-ccb7a0abb62a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:39.091591 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6c93c1b4-fa0c-4ef9-8f5c-ccb7a0abb62a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:39.092025 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6c93c1b4-fa0c-4ef9-8f5c-ccb7a0abb62a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:39.228710 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6c93c1b4-fa0c-4ef9-8f5c-ccb7a0abb62a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:39.236581 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-6c93c1b4-fa0c-4ef9-8f5c-ccb7a0abb62a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1548 microversion: 2.1 time: 0.163670 Jul 15 15:40:39.237139 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 492/989] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:39 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:39.254423 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-af538838-65d3-480f-947d-6caf2347a9e6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:39.257874 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-af538838-65d3-480f-947d-6caf2347a9e6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:39.258674 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-af538838-65d3-480f-947d-6caf2347a9e6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Searching by: {'deleted': False, 'project_id': '25f10e8177434ab69a22f1270cd8d0db'} {{(pid=117998) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 15 15:40:39.266018 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-af538838-65d3-480f-947d-6caf2347a9e6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:39.266456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-af538838-65d3-480f-947d-6caf2347a9e6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:39.267279 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-af538838-65d3-480f-947d-6caf2347a9e6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:39.267707 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-af538838-65d3-480f-947d-6caf2347a9e6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:39.368714 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.multi_cell_list [None req-af538838-65d3-480f-947d-6caf2347a9e6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117998) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 15 15:40:39.484621 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-af538838-65d3-480f-947d-6caf2347a9e6 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.234092 Jul 15 15:40:39.485535 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 498/990] 10.222.0.40 () {58 vars in 1124 bytes} [Fri Jul 15 15:40:39 2022] GET /compute/v2.1/servers => generated 343 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:40:39.496773 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-50174e83-c8c3-433f-9d9a-23904ebce3f9 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:39.497381 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-50174e83-c8c3-433f-9d9a-23904ebce3f9 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:39.503689 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-50174e83-c8c3-433f-9d9a-23904ebce3f9 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:39.504125 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-50174e83-c8c3-433f-9d9a-23904ebce3f9 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:39.504879 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-50174e83-c8c3-433f-9d9a-23904ebce3f9 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:39.505305 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-50174e83-c8c3-433f-9d9a-23904ebce3f9 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:39.651056 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-50174e83-c8c3-433f-9d9a-23904ebce3f9 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:39.659295 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-50174e83-c8c3-433f-9d9a-23904ebce3f9 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1548 microversion: 2.1 time: 0.166870 Jul 15 15:40:39.659865 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 493/991] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:39 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:41.217540 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-db2dd68a-350c-4b41-ad19-348a2839b62a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99b1f280-400c-4892-9a9d-2ce9bcdf246a"}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:40:41.218734 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-db2dd68a-350c-4b41-ad19-348a2839b62a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:41.225585 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-db2dd68a-350c-4b41-ad19-348a2839b62a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:41.226023 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-db2dd68a-350c-4b41-ad19-348a2839b62a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:41.226803 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-db2dd68a-350c-4b41-ad19-348a2839b62a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:41.227223 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-db2dd68a-350c-4b41-ad19-348a2839b62a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:41.503026 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-db2dd68a-350c-4b41-ad19-348a2839b62a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "POST /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290967 Jul 15 15:40:41.504057 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 499/992] 10.222.0.40 () {60 vars in 1322 bytes} [Fri Jul 15 15:40:41 2022] POST /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:40:49.157221 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-36fc8c21-c88e-47b7-8a99-67bb9a8736ed tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:49.158126 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-36fc8c21-c88e-47b7-8a99-67bb9a8736ed tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:49.168105 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-36fc8c21-c88e-47b7-8a99-67bb9a8736ed tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:49.168846 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-36fc8c21-c88e-47b7-8a99-67bb9a8736ed tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:49.170046 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-36fc8c21-c88e-47b7-8a99-67bb9a8736ed tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:49.170725 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-36fc8c21-c88e-47b7-8a99-67bb9a8736ed tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:49.317331 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-36fc8c21-c88e-47b7-8a99-67bb9a8736ed tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:49.326247 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-36fc8c21-c88e-47b7-8a99-67bb9a8736ed tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1594 microversion: 2.1 time: 0.175370 Jul 15 15:40:49.327034 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 494/993] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:49 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1594 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:40:51.354702 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:40:51.356781 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=9 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:40:51.364653 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-da991a64-cdff-4114-93c1-2a87530c4539 req-46732314-2489-496b-b8db-bb96c89e1ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c767fdb-5253-437d-8856-2c5a8934d8ca", "tag": "1fa2eb43-8651-449a-adde-4193c18db06c"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:40:51.380087 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-da991a64-cdff-4114-93c1-2a87530c4539 req-46732314-2489-496b-b8db-bb96c89e1ce7 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:51.380768 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-da991a64-cdff-4114-93c1-2a87530c4539 req-46732314-2489-496b-b8db-bb96c89e1ce7 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:51.399836 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-da991a64-cdff-4114-93c1-2a87530c4539 req-46732314-2489-496b-b8db-bb96c89e1ce7 service nova] Creating event network-changed:1fa2eb43-8651-449a-adde-4193c18db06c for instance 3c767fdb-5253-437d-8856-2c5a8934d8ca on hv-cinder-85001 Jul 15 15:40:51.408128 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-da991a64-cdff-4114-93c1-2a87530c4539 req-46732314-2489-496b-b8db-bb96c89e1ce7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055239 Jul 15 15:40:51.409128 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 500/994] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:40:52.836590 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-bf682ee2-1d01-490b-8a5e-60d5819bf711 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-483714152"}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:40:52.837158 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-bf682ee2-1d01-490b-8a5e-60d5819bf711 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:52.844274 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bf682ee2-1d01-490b-8a5e-60d5819bf711 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:52.844715 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bf682ee2-1d01-490b-8a5e-60d5819bf711 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:52.845477 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bf682ee2-1d01-490b-8a5e-60d5819bf711 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:52.845906 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bf682ee2-1d01-490b-8a5e-60d5819bf711 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:52.984339 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.network.security_group_api [None req-bf682ee2-1d01-490b-8a5e-60d5819bf711 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Adding security group 82d6c3a0-1e0e-4534-8b53-9274d0ea1b25 to port 1fa2eb43-8651-449a-adde-4193c18db06c Jul 15 15:40:53.370480 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-bf682ee2-1d01-490b-8a5e-60d5819bf711 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "POST /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca/action" status: 202 len: 0 microversion: 2.1 time: 0.538229 Jul 15 15:40:53.372498 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 495/995] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 15 15:40:52 2022] POST /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 15:40:53.397076 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-a029bef8-9570-4d0b-8324-1c8b470ece5a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:40:53.400883 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-4e2fed32-d5dd-4049-93fe-1339bed44b68 req-35b389c2-f7be-44a7-8aac-55082ccb0fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c767fdb-5253-437d-8856-2c5a8934d8ca", "tag": "1fa2eb43-8651-449a-adde-4193c18db06c"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:40:53.411850 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-a029bef8-9570-4d0b-8324-1c8b470ece5a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:40:53.425827 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-4e2fed32-d5dd-4049-93fe-1339bed44b68 req-35b389c2-f7be-44a7-8aac-55082ccb0fa5 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:53.427032 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a029bef8-9570-4d0b-8324-1c8b470ece5a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:53.427570 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a029bef8-9570-4d0b-8324-1c8b470ece5a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:53.428127 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-4e2fed32-d5dd-4049-93fe-1339bed44b68 req-35b389c2-f7be-44a7-8aac-55082ccb0fa5 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:53.429086 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a029bef8-9570-4d0b-8324-1c8b470ece5a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:40:53.431614 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a029bef8-9570-4d0b-8324-1c8b470ece5a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:40:53.448619 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-4e2fed32-d5dd-4049-93fe-1339bed44b68 req-35b389c2-f7be-44a7-8aac-55082ccb0fa5 service nova] Creating event network-changed:1fa2eb43-8651-449a-adde-4193c18db06c for instance 3c767fdb-5253-437d-8856-2c5a8934d8ca on hv-cinder-85001 Jul 15 15:40:53.454763 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-4e2fed32-d5dd-4049-93fe-1339bed44b68 req-35b389c2-f7be-44a7-8aac-55082ccb0fa5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076991 Jul 15 15:40:53.455969 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 501/996] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:40:53.751699 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-a029bef8-9570-4d0b-8324-1c8b470ece5a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:40:53.765444 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-a029bef8-9570-4d0b-8324-1c8b470ece5a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1759 microversion: 2.1 time: 0.380593 Jul 15 15:40:53.766922 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 496/997] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:40:53 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1759 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:41:35.228629 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-dbe4bf51-1c98-432f-a20f-893dd2fcaa33 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:41:35.229271 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-dbe4bf51-1c98-432f-a20f-893dd2fcaa33 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:41:35.231435 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=4 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:41:35.232072 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:41:35.238256 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dbe4bf51-1c98-432f-a20f-893dd2fcaa33 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:35.238724 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dbe4bf51-1c98-432f-a20f-893dd2fcaa33 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:35.239479 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dbe4bf51-1c98-432f-a20f-893dd2fcaa33 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:35.239900 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dbe4bf51-1c98-432f-a20f-893dd2fcaa33 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:35.265037 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-dbe4bf51-1c98-432f-a20f-893dd2fcaa33 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b/ips" status: 200 len: 151 microversion: 2.1 time: 0.040818 Jul 15 15:41:35.265602 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 502/998] 10.222.0.40 () {58 vars in 1247 bytes} [Fri Jul 15 15:41:35 2022] GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:41:36.638274 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-dec01495-2ccc-44ad-9578-b120d9ab37b5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9c61664-9ff3-4624-b487-a8494d7b7e57"}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:41:36.639427 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-dec01495-2ccc-44ad-9578-b120d9ab37b5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:41:36.641409 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=13 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:41:36.642054 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=69 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:41:36.648279 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-dec01495-2ccc-44ad-9578-b120d9ab37b5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:36.648741 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-dec01495-2ccc-44ad-9578-b120d9ab37b5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:36.649495 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-dec01495-2ccc-44ad-9578-b120d9ab37b5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:36.649909 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-dec01495-2ccc-44ad-9578-b120d9ab37b5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:37.007137 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-dec01495-2ccc-44ad-9578-b120d9ab37b5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "POST /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372903 Jul 15 15:41:37.007663 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 497/999] 10.222.0.40 () {60 vars in 1322 bytes} [Fri Jul 15 15:41:36 2022] POST /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b/os-volume_attachments => generated 194 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:41:44.531498 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-09a2ffc9-1fe6-4ad9-b9f0-a25feed1accd tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Action: 'create', calling method: .version_select at 0x7fe3c670b550>, body: {"keypair": {"name": "tempest-keypair-1660197882", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6E9H8y3D1ltrZDb9viEu0ElNhk/zqB5WYP65FALU1KgFFWVI+wcVU+3OS5xd+grkg3orDNl+QSL4gTirn2RmKGn0KcqaRb2d+Vfipuo31Hbj/1+H0ShKRiohlG9DgsAg=="}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:41:44.546622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-09a2ffc9-1fe6-4ad9-b9f0-a25feed1accd tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Getting quotas for project 46caece212e44751ba83b3dbfc8176ee. Resources: {'key_pairs'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:41:44.550726 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-09a2ffc9-1fe6-4ad9-b9f0-a25feed1accd tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Getting quotas for user 862f9a645a6f4ffe8c0518504ed6d47c and project 46caece212e44751ba83b3dbfc8176ee. Resources: {'key_pairs'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:41:44.576419 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-09a2ffc9-1fe6-4ad9-b9f0-a25feed1accd tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048783 Jul 15 15:41:44.577023 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 503/1000] 10.222.0.40 () {60 vars in 1158 bytes} [Fri Jul 15 15:41:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:41:45.913539 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-2b91f603-a355-43a3-abb0-e8e9ca5ba052 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1184422629", "imageRef": "b9770891-ef3b-4f53-a989-3a4db420d5c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2849d693-fbe8-4fb0-bb77-6756df5e3eca"}], "security_groups": [{"name": "tempest-securitygroup--1702624037"}], "key_name": "tempest-keypair-1660197882", "user_data": "}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:41:46.024631 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.network.neutron [None req-2b91f603-a355-43a3-abb0-e8e9ca5ba052 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] validate_networks() for [('2849d693-fbe8-4fb0-bb77-6756df5e3eca', None, None, None, None, None)] {{(pid=117999) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:41:46.402114 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-2b91f603-a355-43a3-abb0-e8e9ca5ba052 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Flavor limits 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:41:46.402502 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-2b91f603-a355-43a3-abb0-e8e9ca5ba052 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Image limits 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:41:46.403178 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-2b91f603-a355-43a3-abb0-e8e9ca5ba052 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Flavor pref 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:41:46.403744 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-2b91f603-a355-43a3-abb0-e8e9ca5ba052 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Image pref 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:41:46.404407 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-2b91f603-a355-43a3-abb0-e8e9ca5ba052 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:41:46.415431 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2b91f603-a355-43a3-abb0-e8e9ca5ba052 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:46.415874 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2b91f603-a355-43a3-abb0-e8e9ca5ba052 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:46.416700 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2b91f603-a355-43a3-abb0-e8e9ca5ba052 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:46.417102 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2b91f603-a355-43a3-abb0-e8e9ca5ba052 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:46.434891 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-2b91f603-a355-43a3-abb0-e8e9ca5ba052 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Getting quotas for project 46caece212e44751ba83b3dbfc8176ee. Resources: {'ram', 'instances', 'cores'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:41:46.439102 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-2b91f603-a355-43a3-abb0-e8e9ca5ba052 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Getting quotas for user 862f9a645a6f4ffe8c0518504ed6d47c and project 46caece212e44751ba83b3dbfc8176ee. Resources: {'ram', 'instances', 'cores'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:41:46.451240 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-2b91f603-a355-43a3-abb0-e8e9ca5ba052 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Going to run 1 instances... {{(pid=117999) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:41:46.453597 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-2b91f603-a355-43a3-abb0-e8e9ca5ba052 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9770891-ef3b-4f53-a989-3a4db420d5c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117999) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:41:46.501364 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-2b91f603-a355-43a3-abb0-e8e9ca5ba052 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.593828 Jul 15 15:41:46.502212 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 498/1001] 10.222.0.40 () {60 vars in 1146 bytes} [Fri Jul 15 15:41:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 15:41:46.512953 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8d1d1f44-c1d1-4d5a-8dda-7ef9389ba9f4 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:41:46.513583 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8d1d1f44-c1d1-4d5a-8dda-7ef9389ba9f4 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:41:46.516007 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=4 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:41:46.636812 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8d1d1f44-c1d1-4d5a-8dda-7ef9389ba9f4 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:41:46.644236 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8d1d1f44-c1d1-4d5a-8dda-7ef9389ba9f4 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d" status: 200 len: 1242 microversion: 2.1 time: 0.135479 Jul 15 15:41:46.645124 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 504/1002] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:41:46 2022] GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d => generated 1242 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:41:47.662249 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-90e6d249-667c-4ab3-99c7-f5f53a607c1d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:41:47.662936 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-90e6d249-667c-4ab3-99c7-f5f53a607c1d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:41:47.670118 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-90e6d249-667c-4ab3-99c7-f5f53a607c1d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:47.670569 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-90e6d249-667c-4ab3-99c7-f5f53a607c1d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:47.671330 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-90e6d249-667c-4ab3-99c7-f5f53a607c1d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:47.671767 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-90e6d249-667c-4ab3-99c7-f5f53a607c1d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:47.831984 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-90e6d249-667c-4ab3-99c7-f5f53a607c1d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:41:47.846741 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-90e6d249-667c-4ab3-99c7-f5f53a607c1d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d" status: 200 len: 1300 microversion: 2.1 time: 0.188754 Jul 15 15:41:47.848539 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 499/1003] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:41:47 2022] GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d => generated 1300 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:41:48.866220 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-71108dbd-a55b-44a8-90b1-ec82f399baf2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:41:48.866891 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-71108dbd-a55b-44a8-90b1-ec82f399baf2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:41:48.873678 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-71108dbd-a55b-44a8-90b1-ec82f399baf2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:48.874117 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-71108dbd-a55b-44a8-90b1-ec82f399baf2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:48.874903 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-71108dbd-a55b-44a8-90b1-ec82f399baf2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:48.875329 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-71108dbd-a55b-44a8-90b1-ec82f399baf2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:49.066801 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-71108dbd-a55b-44a8-90b1-ec82f399baf2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:41:49.075049 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-71108dbd-a55b-44a8-90b1-ec82f399baf2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d" status: 200 len: 1368 microversion: 2.1 time: 0.212831 Jul 15 15:41:49.075534 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 505/1004] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:41:48 2022] GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d => generated 1368 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:41:49.379936 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-1768b399-1264-4060-a2d3-f3911b85c963 req-1e4ea0f0-7af0-4e91-a099-23538d459f3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d", "tag": "ff327a59-ca88-4701-a612-4a72e896a4b2"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:41:49.394990 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-1768b399-1264-4060-a2d3-f3911b85c963 req-1e4ea0f0-7af0-4e91-a099-23538d459f3e service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:49.395503 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-1768b399-1264-4060-a2d3-f3911b85c963 req-1e4ea0f0-7af0-4e91-a099-23538d459f3e service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:49.415642 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-1768b399-1264-4060-a2d3-f3911b85c963 req-1e4ea0f0-7af0-4e91-a099-23538d459f3e service nova] Creating event network-changed:ff327a59-ca88-4701-a612-4a72e896a4b2 for instance 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d on hv-cinder-85001 Jul 15 15:41:49.424700 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-1768b399-1264-4060-a2d3-f3911b85c963 req-1e4ea0f0-7af0-4e91-a099-23538d459f3e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047933 Jul 15 15:41:49.425648 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 500/1005] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:41:50.092893 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-beb7dbe1-0b8b-4508-abb7-7224505bb05f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:41:50.093518 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-beb7dbe1-0b8b-4508-abb7-7224505bb05f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:41:50.100589 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-beb7dbe1-0b8b-4508-abb7-7224505bb05f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:50.101031 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-beb7dbe1-0b8b-4508-abb7-7224505bb05f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:50.101784 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-beb7dbe1-0b8b-4508-abb7-7224505bb05f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:50.102235 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-beb7dbe1-0b8b-4508-abb7-7224505bb05f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:50.239019 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-beb7dbe1-0b8b-4508-abb7-7224505bb05f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:41:50.247600 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-beb7dbe1-0b8b-4508-abb7-7224505bb05f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d" status: 200 len: 1368 microversion: 2.1 time: 0.158795 Jul 15 15:41:50.248171 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 506/1006] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:41:50 2022] GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:41:51.265924 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-5ddbb92f-c7c7-498c-8eee-00e12a8408b5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:41:51.266618 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-5ddbb92f-c7c7-498c-8eee-00e12a8408b5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:41:51.274611 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5ddbb92f-c7c7-498c-8eee-00e12a8408b5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:51.275060 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5ddbb92f-c7c7-498c-8eee-00e12a8408b5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:51.275826 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5ddbb92f-c7c7-498c-8eee-00e12a8408b5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:51.276256 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5ddbb92f-c7c7-498c-8eee-00e12a8408b5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:51.409131 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-5ddbb92f-c7c7-498c-8eee-00e12a8408b5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:41:51.417189 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-5ddbb92f-c7c7-498c-8eee-00e12a8408b5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d" status: 200 len: 1368 microversion: 2.1 time: 0.155596 Jul 15 15:41:51.417782 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 501/1007] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:41:51 2022] GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:41:52.433547 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-bee55fe7-fd82-4ac3-9b33-03f69eddc9ae tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:41:52.434173 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-bee55fe7-fd82-4ac3-9b33-03f69eddc9ae tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:41:52.440825 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bee55fe7-fd82-4ac3-9b33-03f69eddc9ae tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:52.441272 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bee55fe7-fd82-4ac3-9b33-03f69eddc9ae tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:52.442296 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bee55fe7-fd82-4ac3-9b33-03f69eddc9ae tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:52.442783 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bee55fe7-fd82-4ac3-9b33-03f69eddc9ae tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:52.590892 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-bee55fe7-fd82-4ac3-9b33-03f69eddc9ae tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:41:52.600248 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-bee55fe7-fd82-4ac3-9b33-03f69eddc9ae tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d" status: 200 len: 1368 microversion: 2.1 time: 0.170664 Jul 15 15:41:52.600866 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 507/1008] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:41:52 2022] GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:41:53.617453 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-45d937da-d7e8-4523-9f42-1fc6baf9daa8 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:41:53.618254 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-45d937da-d7e8-4523-9f42-1fc6baf9daa8 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:41:53.625133 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-45d937da-d7e8-4523-9f42-1fc6baf9daa8 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:53.625581 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-45d937da-d7e8-4523-9f42-1fc6baf9daa8 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:53.626349 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-45d937da-d7e8-4523-9f42-1fc6baf9daa8 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:53.626812 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-45d937da-d7e8-4523-9f42-1fc6baf9daa8 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:53.772916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-45d937da-d7e8-4523-9f42-1fc6baf9daa8 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:41:53.785404 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-45d937da-d7e8-4523-9f42-1fc6baf9daa8 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d" status: 200 len: 1368 microversion: 2.1 time: 0.171382 Jul 15 15:41:53.786492 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 502/1009] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:41:53 2022] GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:41:54.809324 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-aa7f55ee-fb83-40b2-bac5-4e8719da6aa2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:41:54.809908 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-aa7f55ee-fb83-40b2-bac5-4e8719da6aa2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:41:54.817185 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aa7f55ee-fb83-40b2-bac5-4e8719da6aa2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:54.817663 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aa7f55ee-fb83-40b2-bac5-4e8719da6aa2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:54.818490 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aa7f55ee-fb83-40b2-bac5-4e8719da6aa2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:54.819138 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aa7f55ee-fb83-40b2-bac5-4e8719da6aa2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:54.963388 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-aa7f55ee-fb83-40b2-bac5-4e8719da6aa2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:41:54.971156 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-aa7f55ee-fb83-40b2-bac5-4e8719da6aa2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d" status: 200 len: 1368 microversion: 2.1 time: 0.165664 Jul 15 15:41:54.971706 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 508/1010] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:41:54 2022] GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:41:55.224891 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-91500f8c-d61d-46e2-bf6f-8ed7ca404663 req-67cad36e-e81b-45c0-a51e-f1761ccc5e04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d", "name": "network-vif-plugged", "status": "completed", "tag": "ff327a59-ca88-4701-a612-4a72e896a4b2"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:41:55.237603 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-91500f8c-d61d-46e2-bf6f-8ed7ca404663 req-67cad36e-e81b-45c0-a51e-f1761ccc5e04 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:55.238079 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-91500f8c-d61d-46e2-bf6f-8ed7ca404663 req-67cad36e-e81b-45c0-a51e-f1761ccc5e04 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:55.252276 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-91500f8c-d61d-46e2-bf6f-8ed7ca404663 req-67cad36e-e81b-45c0-a51e-f1761ccc5e04 service nova] Creating event network-vif-plugged:ff327a59-ca88-4701-a612-4a72e896a4b2 for instance 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d on hv-cinder-85001 Jul 15 15:41:55.258297 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-91500f8c-d61d-46e2-bf6f-8ed7ca404663 req-67cad36e-e81b-45c0-a51e-f1761ccc5e04 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037687 Jul 15 15:41:55.259320 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 503/1011] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:41:55.990164 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7c8bc7da-2924-4067-9182-80dab4d8fb84 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:41:55.990866 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7c8bc7da-2924-4067-9182-80dab4d8fb84 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:41:55.999519 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7c8bc7da-2924-4067-9182-80dab4d8fb84 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:56.000181 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7c8bc7da-2924-4067-9182-80dab4d8fb84 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:56.000968 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7c8bc7da-2924-4067-9182-80dab4d8fb84 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:56.001402 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7c8bc7da-2924-4067-9182-80dab4d8fb84 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:56.157966 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7c8bc7da-2924-4067-9182-80dab4d8fb84 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:41:56.165967 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7c8bc7da-2924-4067-9182-80dab4d8fb84 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d" status: 200 len: 1368 microversion: 2.1 time: 0.180277 Jul 15 15:41:56.166552 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 509/1012] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:41:55 2022] GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:41:57.181679 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=2 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:41:57.182724 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=6 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:41:57.187423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-ea3469d4-dccf-4eb2-9751-82c3cc6bc74b tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:41:57.188118 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-ea3469d4-dccf-4eb2-9751-82c3cc6bc74b tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:41:57.195480 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ea3469d4-dccf-4eb2-9751-82c3cc6bc74b tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:57.195924 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ea3469d4-dccf-4eb2-9751-82c3cc6bc74b tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:57.196677 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ea3469d4-dccf-4eb2-9751-82c3cc6bc74b tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:57.197102 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ea3469d4-dccf-4eb2-9751-82c3cc6bc74b tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:57.335316 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-ea3469d4-dccf-4eb2-9751-82c3cc6bc74b tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:41:57.343357 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-ea3469d4-dccf-4eb2-9751-82c3cc6bc74b tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d" status: 200 len: 1368 microversion: 2.1 time: 0.163248 Jul 15 15:41:57.343927 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 504/1013] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:41:57 2022] GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:41:58.361135 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ec70547a-d0c5-4b54-8a66-5073f112574b tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:41:58.361756 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ec70547a-d0c5-4b54-8a66-5073f112574b tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:41:58.363677 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=6 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:41:58.370236 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ec70547a-d0c5-4b54-8a66-5073f112574b tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:58.370701 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ec70547a-d0c5-4b54-8a66-5073f112574b tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:58.371459 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ec70547a-d0c5-4b54-8a66-5073f112574b tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:58.371886 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ec70547a-d0c5-4b54-8a66-5073f112574b tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:58.504713 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ec70547a-d0c5-4b54-8a66-5073f112574b tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:41:58.512538 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ec70547a-d0c5-4b54-8a66-5073f112574b tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d" status: 200 len: 1558 microversion: 2.1 time: 0.155342 Jul 15 15:41:58.513112 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 510/1014] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:41:58 2022] GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:41:58.529338 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-a976dcbf-6d84-45a7-95af-246ad6a43acf tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:41:58.529913 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-a976dcbf-6d84-45a7-95af-246ad6a43acf tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:41:58.537415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a976dcbf-6d84-45a7-95af-246ad6a43acf tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:58.537857 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a976dcbf-6d84-45a7-95af-246ad6a43acf tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:58.538662 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a976dcbf-6d84-45a7-95af-246ad6a43acf tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:58.539093 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a976dcbf-6d84-45a7-95af-246ad6a43acf tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:58.620791 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-a976dcbf-6d84-45a7-95af-246ad6a43acf tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095371 Jul 15 15:41:58.621385 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 505/1015] 10.222.0.40 () {58 vars in 1274 bytes} [Fri Jul 15 15:41:58 2022] GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:41:59.595648 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-360252e6-78b7-4c83-bcb5-58f84c872436 req-449b0d76-2b33-4a57-9d8d-e86146b795cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d", "tag": "ff327a59-ca88-4701-a612-4a72e896a4b2"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:41:59.604599 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-360252e6-78b7-4c83-bcb5-58f84c872436 req-449b0d76-2b33-4a57-9d8d-e86146b795cd service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:41:59.605027 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-360252e6-78b7-4c83-bcb5-58f84c872436 req-449b0d76-2b33-4a57-9d8d-e86146b795cd service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:41:59.616161 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-360252e6-78b7-4c83-bcb5-58f84c872436 req-449b0d76-2b33-4a57-9d8d-e86146b795cd service nova] Creating event network-changed:ff327a59-ca88-4701-a612-4a72e896a4b2 for instance 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d on hv-cinder-85001 Jul 15 15:41:59.621439 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-360252e6-78b7-4c83-bcb5-58f84c872436 req-449b0d76-2b33-4a57-9d8d-e86146b795cd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029526 Jul 15 15:41:59.622759 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 511/1016] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:42:19.645566 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:42:19.646213 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:42:19.651125 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-ea36bc11-cac7-4f67-aeb2-99ccb2b92571 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:42:19.652080 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-ea36bc11-cac7-4f67-aeb2-99ccb2b92571 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:42:19.659667 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ea36bc11-cac7-4f67-aeb2-99ccb2b92571 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:19.660174 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ea36bc11-cac7-4f67-aeb2-99ccb2b92571 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:19.661012 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ea36bc11-cac7-4f67-aeb2-99ccb2b92571 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:19.661472 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ea36bc11-cac7-4f67-aeb2-99ccb2b92571 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:19.743624 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-ea36bc11-cac7-4f67-aeb2-99ccb2b92571 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "POST /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca/action" status: 202 len: 0 microversion: 2.1 time: 0.099184 Jul 15 15:42:19.746235 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 506/1017] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 15 15:42:19 2022] POST /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:42:19.753514 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e0621a20-b740-462e-8cea-f05db8617c65 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:42:19.754223 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e0621a20-b740-462e-8cea-f05db8617c65 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:42:19.757438 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:42:19.758499 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=38 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:42:19.764869 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e0621a20-b740-462e-8cea-f05db8617c65 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:19.765367 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e0621a20-b740-462e-8cea-f05db8617c65 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:19.766266 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e0621a20-b740-462e-8cea-f05db8617c65 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:19.766728 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e0621a20-b740-462e-8cea-f05db8617c65 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:19.962669 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e0621a20-b740-462e-8cea-f05db8617c65 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:42:19.971292 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e0621a20-b740-462e-8cea-f05db8617c65 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1751 microversion: 2.1 time: 0.222034 Jul 15 15:42:19.971885 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 512/1018] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:42:19 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1751 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:42:20.994438 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-bda2d803-bed2-430d-aeb3-d66f807e1c4f tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:42:20.995383 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-bda2d803-bed2-430d-aeb3-d66f807e1c4f tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:42:21.005114 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bda2d803-bed2-430d-aeb3-d66f807e1c4f tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:21.005711 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bda2d803-bed2-430d-aeb3-d66f807e1c4f tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:21.006915 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bda2d803-bed2-430d-aeb3-d66f807e1c4f tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:21.007448 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-bda2d803-bed2-430d-aeb3-d66f807e1c4f tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:21.170281 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-bda2d803-bed2-430d-aeb3-d66f807e1c4f tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:42:21.179629 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-bda2d803-bed2-430d-aeb3-d66f807e1c4f tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1756 microversion: 2.1 time: 0.192020 Jul 15 15:42:21.180354 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 507/1019] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:42:20 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1756 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:42:22.199153 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3eda5b8d-3f60-4a7f-927d-41c97ee1c170 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:42:22.199852 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3eda5b8d-3f60-4a7f-927d-41c97ee1c170 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:42:22.208434 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3eda5b8d-3f60-4a7f-927d-41c97ee1c170 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:22.209166 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3eda5b8d-3f60-4a7f-927d-41c97ee1c170 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:22.210350 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3eda5b8d-3f60-4a7f-927d-41c97ee1c170 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:22.211236 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3eda5b8d-3f60-4a7f-927d-41c97ee1c170 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:22.372590 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3eda5b8d-3f60-4a7f-927d-41c97ee1c170 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:42:22.382816 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3eda5b8d-3f60-4a7f-927d-41c97ee1c170 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1756 microversion: 2.1 time: 0.187181 Jul 15 15:42:22.383420 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 513/1020] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:42:22 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:42:23.401586 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-21b6bad7-39e5-4b1c-9f90-3c81b60e4514 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:42:23.402253 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-21b6bad7-39e5-4b1c-9f90-3c81b60e4514 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:42:23.409612 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-21b6bad7-39e5-4b1c-9f90-3c81b60e4514 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:23.410053 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-21b6bad7-39e5-4b1c-9f90-3c81b60e4514 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:23.410907 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-21b6bad7-39e5-4b1c-9f90-3c81b60e4514 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:23.411332 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-21b6bad7-39e5-4b1c-9f90-3c81b60e4514 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:23.570342 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-21b6bad7-39e5-4b1c-9f90-3c81b60e4514 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:42:23.580713 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-21b6bad7-39e5-4b1c-9f90-3c81b60e4514 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1756 microversion: 2.1 time: 0.183215 Jul 15 15:42:23.581448 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 508/1021] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:42:23 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:42:24.602805 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-21d0f384-92c9-4b35-97a1-95fab6ee6257 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:42:24.603522 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-21d0f384-92c9-4b35-97a1-95fab6ee6257 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:42:24.610003 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-21d0f384-92c9-4b35-97a1-95fab6ee6257 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:24.610447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-21d0f384-92c9-4b35-97a1-95fab6ee6257 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:24.611238 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-21d0f384-92c9-4b35-97a1-95fab6ee6257 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:24.611670 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-21d0f384-92c9-4b35-97a1-95fab6ee6257 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:24.780538 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-21d0f384-92c9-4b35-97a1-95fab6ee6257 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:42:24.791868 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-21d0f384-92c9-4b35-97a1-95fab6ee6257 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1756 microversion: 2.1 time: 0.195789 Jul 15 15:42:24.792438 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 514/1022] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:42:24 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1756 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:42:25.809704 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-98188671-38a1-4c76-ab67-44fe4592d1a2 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:42:25.810371 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-98188671-38a1-4c76-ab67-44fe4592d1a2 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:42:25.817786 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-98188671-38a1-4c76-ab67-44fe4592d1a2 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:25.818443 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-98188671-38a1-4c76-ab67-44fe4592d1a2 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:25.819271 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-98188671-38a1-4c76-ab67-44fe4592d1a2 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:25.819707 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-98188671-38a1-4c76-ab67-44fe4592d1a2 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:25.994615 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-98188671-38a1-4c76-ab67-44fe4592d1a2 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:42:26.003221 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-98188671-38a1-4c76-ab67-44fe4592d1a2 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1756 microversion: 2.1 time: 0.197349 Jul 15 15:42:26.003803 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 509/1023] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:42:25 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1756 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:42:27.021507 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b5f3b966-4d29-450b-9dd1-8d46e5e0c0db tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:42:27.022088 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b5f3b966-4d29-450b-9dd1-8d46e5e0c0db tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:42:27.031576 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b5f3b966-4d29-450b-9dd1-8d46e5e0c0db tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:27.032267 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b5f3b966-4d29-450b-9dd1-8d46e5e0c0db tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:27.032774 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b5f3b966-4d29-450b-9dd1-8d46e5e0c0db tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:27.033205 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b5f3b966-4d29-450b-9dd1-8d46e5e0c0db tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:27.262269 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b5f3b966-4d29-450b-9dd1-8d46e5e0c0db tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:42:27.270849 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b5f3b966-4d29-450b-9dd1-8d46e5e0c0db tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1756 microversion: 2.1 time: 0.253273 Jul 15 15:42:27.271430 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 515/1024] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:42:27 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1756 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:42:28.289344 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-98542e1c-2ea6-4a95-a060-9ad26b5a4b67 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:42:28.290721 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-98542e1c-2ea6-4a95-a060-9ad26b5a4b67 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:42:28.299317 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-98542e1c-2ea6-4a95-a060-9ad26b5a4b67 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:28.299760 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-98542e1c-2ea6-4a95-a060-9ad26b5a4b67 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:28.300523 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-98542e1c-2ea6-4a95-a060-9ad26b5a4b67 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:28.300967 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-98542e1c-2ea6-4a95-a060-9ad26b5a4b67 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:28.460703 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-98542e1c-2ea6-4a95-a060-9ad26b5a4b67 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:42:28.469268 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-98542e1c-2ea6-4a95-a060-9ad26b5a4b67 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1756 microversion: 2.1 time: 0.183957 Jul 15 15:42:28.469886 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 510/1025] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:42:28 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:42:29.487848 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3d8c6531-d898-45e4-a15b-6ea587d9201a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:42:29.488451 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3d8c6531-d898-45e4-a15b-6ea587d9201a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:42:29.496474 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3d8c6531-d898-45e4-a15b-6ea587d9201a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:29.496954 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3d8c6531-d898-45e4-a15b-6ea587d9201a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:29.497785 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3d8c6531-d898-45e4-a15b-6ea587d9201a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:29.498293 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3d8c6531-d898-45e4-a15b-6ea587d9201a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:29.666900 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3d8c6531-d898-45e4-a15b-6ea587d9201a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:42:29.677983 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3d8c6531-d898-45e4-a15b-6ea587d9201a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1756 microversion: 2.1 time: 0.193846 Jul 15 15:42:29.678697 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 516/1026] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:42:29 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:42:30.700961 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-a0f91bd5-2265-48d2-93ee-d502bbdbe8ae tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:42:30.701580 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-a0f91bd5-2265-48d2-93ee-d502bbdbe8ae tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:42:30.711226 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a0f91bd5-2265-48d2-93ee-d502bbdbe8ae tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:30.711764 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a0f91bd5-2265-48d2-93ee-d502bbdbe8ae tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:30.712939 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a0f91bd5-2265-48d2-93ee-d502bbdbe8ae tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:30.717474 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a0f91bd5-2265-48d2-93ee-d502bbdbe8ae tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:30.869737 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-a0f91bd5-2265-48d2-93ee-d502bbdbe8ae tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:42:30.878413 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-a0f91bd5-2265-48d2-93ee-d502bbdbe8ae tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1756 microversion: 2.1 time: 0.181423 Jul 15 15:42:30.879086 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 511/1027] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:42:30 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:42:31.901552 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c256ce41-f1d3-42a0-9cd1-b87373c5435a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:42:31.902303 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-c256ce41-f1d3-42a0-9cd1-b87373c5435a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:42:31.909565 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c256ce41-f1d3-42a0-9cd1-b87373c5435a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:31.909993 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c256ce41-f1d3-42a0-9cd1-b87373c5435a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:31.910795 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c256ce41-f1d3-42a0-9cd1-b87373c5435a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:31.911242 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c256ce41-f1d3-42a0-9cd1-b87373c5435a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:32.068808 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c256ce41-f1d3-42a0-9cd1-b87373c5435a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:42:32.078024 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-c256ce41-f1d3-42a0-9cd1-b87373c5435a tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1756 microversion: 2.1 time: 0.180627 Jul 15 15:42:32.078630 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 517/1028] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:42:31 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:42:33.095748 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-966e3e67-4ed7-4446-8263-856a3178e3a7 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:42:33.096342 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-966e3e67-4ed7-4446-8263-856a3178e3a7 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:42:33.105156 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-966e3e67-4ed7-4446-8263-856a3178e3a7 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:33.105637 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-966e3e67-4ed7-4446-8263-856a3178e3a7 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:33.106557 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-966e3e67-4ed7-4446-8263-856a3178e3a7 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:33.107059 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-966e3e67-4ed7-4446-8263-856a3178e3a7 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:33.271120 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-966e3e67-4ed7-4446-8263-856a3178e3a7 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:42:33.281411 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-966e3e67-4ed7-4446-8263-856a3178e3a7 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1756 microversion: 2.1 time: 0.189439 Jul 15 15:42:33.282003 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 512/1029] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:42:33 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:42:34.306628 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e3c58b8d-1683-4d47-997f-bca4e7d05f92 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:42:34.307591 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e3c58b8d-1683-4d47-997f-bca4e7d05f92 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:42:34.316334 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e3c58b8d-1683-4d47-997f-bca4e7d05f92 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:34.316845 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e3c58b8d-1683-4d47-997f-bca4e7d05f92 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:34.317999 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e3c58b8d-1683-4d47-997f-bca4e7d05f92 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:34.318463 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e3c58b8d-1683-4d47-997f-bca4e7d05f92 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:34.484280 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e3c58b8d-1683-4d47-997f-bca4e7d05f92 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:42:34.492980 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e3c58b8d-1683-4d47-997f-bca4e7d05f92 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1756 microversion: 2.1 time: 0.192607 Jul 15 15:42:34.493737 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 518/1030] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:42:34 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1756 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:42:35.510302 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-5b295990-6747-4029-a7e3-864290c2ad35 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:42:35.510925 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-5b295990-6747-4029-a7e3-864290c2ad35 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:42:35.518615 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5b295990-6747-4029-a7e3-864290c2ad35 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:35.519057 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5b295990-6747-4029-a7e3-864290c2ad35 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:35.519855 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5b295990-6747-4029-a7e3-864290c2ad35 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:35.520286 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5b295990-6747-4029-a7e3-864290c2ad35 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:35.700398 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-5b295990-6747-4029-a7e3-864290c2ad35 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:42:35.712524 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-5b295990-6747-4029-a7e3-864290c2ad35 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1756 microversion: 2.1 time: 0.206103 Jul 15 15:42:35.713156 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 513/1031] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:42:35 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1756 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:42:36.732141 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-fc295b87-544d-461b-8580-65d5018641b9 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:42:36.732801 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-fc295b87-544d-461b-8580-65d5018641b9 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:42:36.738990 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fc295b87-544d-461b-8580-65d5018641b9 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:36.739435 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fc295b87-544d-461b-8580-65d5018641b9 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:36.740203 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fc295b87-544d-461b-8580-65d5018641b9 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:36.740637 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fc295b87-544d-461b-8580-65d5018641b9 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:36.912707 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-fc295b87-544d-461b-8580-65d5018641b9 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:42:36.924747 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-fc295b87-544d-461b-8580-65d5018641b9 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1756 microversion: 2.1 time: 0.197389 Jul 15 15:42:36.925582 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 519/1032] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:42:36 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1756 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:42:37.947454 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-fec5adcf-7b2e-4589-8ef0-bc5c1c2864f3 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:42:37.948152 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-fec5adcf-7b2e-4589-8ef0-bc5c1c2864f3 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:42:37.955049 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fec5adcf-7b2e-4589-8ef0-bc5c1c2864f3 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:37.955516 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fec5adcf-7b2e-4589-8ef0-bc5c1c2864f3 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:37.956287 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fec5adcf-7b2e-4589-8ef0-bc5c1c2864f3 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:42:37.956718 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fec5adcf-7b2e-4589-8ef0-bc5c1c2864f3 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:42:38.112827 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-fec5adcf-7b2e-4589-8ef0-bc5c1c2864f3 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:42:38.121691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-fec5adcf-7b2e-4589-8ef0-bc5c1c2864f3 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1759 microversion: 2.1 time: 0.179141 Jul 15 15:42:38.122495 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 514/1033] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:42:37 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1759 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:43:00.455025 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-aa8d75c7-e889-47ea-bd76-c4f747ba68c8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1501786509", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1986937243", "security_groups": [{"name": "tempest-secgroup-smoke-153259507"}], "block_device_mapping_v2": [{"uuid": "b9ef28a1-a294-4fe5-a2fa-59bb84d93a84", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9b60a386-f1f7-4772-81d0-41c3770d705b"}]}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:43:00.463066 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=16 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:43:00.463708 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=48 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:43:00.580635 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.network.neutron [None req-aa8d75c7-e889-47ea-bd76-c4f747ba68c8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] validate_networks() for [('9b60a386-f1f7-4772-81d0-41c3770d705b', None, None, None, None, None)] {{(pid=117998) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:43:01.029580 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-aa8d75c7-e889-47ea-bd76-c4f747ba68c8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Flavor limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:43:01.029992 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-aa8d75c7-e889-47ea-bd76-c4f747ba68c8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Image limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:43:01.030451 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-aa8d75c7-e889-47ea-bd76-c4f747ba68c8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Flavor pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:43:01.030919 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-aa8d75c7-e889-47ea-bd76-c4f747ba68c8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Image pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:43:01.031319 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-aa8d75c7-e889-47ea-bd76-c4f747ba68c8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:43:01.041459 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aa8d75c7-e889-47ea-bd76-c4f747ba68c8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:01.041894 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aa8d75c7-e889-47ea-bd76-c4f747ba68c8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:01.042701 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aa8d75c7-e889-47ea-bd76-c4f747ba68c8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:01.043126 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aa8d75c7-e889-47ea-bd76-c4f747ba68c8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:01.061618 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-aa8d75c7-e889-47ea-bd76-c4f747ba68c8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Getting quotas for project 9bda8b2837a54ec5a75c7dc355571255. Resources: {'ram', 'instances', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:43:01.065968 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-aa8d75c7-e889-47ea-bd76-c4f747ba68c8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Getting quotas for user 4453bd7126a849f29cfe3d8bdf4531f1 and project 9bda8b2837a54ec5a75c7dc355571255. Resources: {'ram', 'instances', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:43:01.133946 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-aa8d75c7-e889-47ea-bd76-c4f747ba68c8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Going to run 1 instances... {{(pid=117998) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:43:01.137166 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-aa8d75c7-e889-47ea-bd76-c4f747ba68c8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 2973f7a5-3d6d-4aac-96d9-3a72c3be370a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b9ef28a1-a294-4fe5-a2fa-59bb84d93a84',volume_size=None,volume_type=None)] {{(pid=117998) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:43:01.272601 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR oslo.messaging._drivers.impl_rabbit [None req-aa8d75c7-e889-47ea-bd76-c4f747ba68c8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [6d3cb44e-a5c2-489d-941d-8241038db6b8] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 15 15:43:02.282167 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO oslo.messaging._drivers.impl_rabbit [None req-aa8d75c7-e889-47ea-bd76-c4f747ba68c8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [6d3cb44e-a5c2-489d-941d-8241038db6b8] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 46190. Jul 15 15:43:02.288738 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-aa8d75c7-e889-47ea-bd76-c4f747ba68c8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.837762 Jul 15 15:43:02.289366 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 520/1034] 10.222.0.40 () {60 vars in 1146 bytes} [Fri Jul 15 15:43:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 1839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 15:43:02.300035 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-eab925db-1b8e-4b6b-a9fd-eb42bc504c9d tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:43:02.300648 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-eab925db-1b8e-4b6b-a9fd-eb42bc504c9d tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 2973f7a5-3d6d-4aac-96d9-3a72c3be370a] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:02.303456 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=18 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:43:02.304105 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:43:02.360922 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-eab925db-1b8e-4b6b-a9fd-eb42bc504c9d tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:43:02.368255 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-eab925db-1b8e-4b6b-a9fd-eb42bc504c9d tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a" status: 200 len: 1095 microversion: 2.1 time: 0.072203 Jul 15 15:43:02.368864 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 515/1035] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:43:02 2022] GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:43:03.387776 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5fa3298c-979e-4fd1-8f24-12f580762677 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:43:03.388505 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5fa3298c-979e-4fd1-8f24-12f580762677 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 2973f7a5-3d6d-4aac-96d9-3a72c3be370a] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:03.450483 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5fa3298c-979e-4fd1-8f24-12f580762677 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:43:03.457555 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5fa3298c-979e-4fd1-8f24-12f580762677 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a" status: 200 len: 1095 microversion: 2.1 time: 0.074427 Jul 15 15:43:03.458125 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 521/1036] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:43:03 2022] GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:43:04.479000 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-4f3045c5-8185-4f7b-9f66-50dfecd47b0a tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:43:04.479944 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-4f3045c5-8185-4f7b-9f66-50dfecd47b0a tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 2973f7a5-3d6d-4aac-96d9-3a72c3be370a] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:04.541823 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-4f3045c5-8185-4f7b-9f66-50dfecd47b0a tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:43:04.550016 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-4f3045c5-8185-4f7b-9f66-50dfecd47b0a tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a" status: 200 len: 1095 microversion: 2.1 time: 0.077600 Jul 15 15:43:04.550671 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 516/1037] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:43:04 2022] GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:43:05.566798 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4cf64274-aed8-49cc-88fe-58677cd6345e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:43:05.569924 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-4cf64274-aed8-49cc-88fe-58677cd6345e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 2973f7a5-3d6d-4aac-96d9-3a72c3be370a] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:05.624019 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-4cf64274-aed8-49cc-88fe-58677cd6345e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:43:05.631155 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4cf64274-aed8-49cc-88fe-58677cd6345e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a" status: 200 len: 1095 microversion: 2.1 time: 0.068352 Jul 15 15:43:05.631726 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 522/1038] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:43:05 2022] GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:43:06.651724 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-9b3d24b5-2186-42a1-87ea-c4bb7f8e995b tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:43:06.652339 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-9b3d24b5-2186-42a1-87ea-c4bb7f8e995b tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 2973f7a5-3d6d-4aac-96d9-3a72c3be370a] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:06.662965 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9b3d24b5-2186-42a1-87ea-c4bb7f8e995b tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:06.663679 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9b3d24b5-2186-42a1-87ea-c4bb7f8e995b tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:06.664927 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9b3d24b5-2186-42a1-87ea-c4bb7f8e995b tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:06.665626 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9b3d24b5-2186-42a1-87ea-c4bb7f8e995b tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:06.727707 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-9b3d24b5-2186-42a1-87ea-c4bb7f8e995b tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:43:06.736041 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-9b3d24b5-2186-42a1-87ea-c4bb7f8e995b tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a" status: 200 len: 1145 microversion: 2.1 time: 0.090847 Jul 15 15:43:06.736604 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 517/1039] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:43:06 2022] GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a => generated 1145 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:43:07.754005 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-aa1f24b0-d87a-4500-9e06-352e67cda41f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:43:07.754656 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-aa1f24b0-d87a-4500-9e06-352e67cda41f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 2973f7a5-3d6d-4aac-96d9-3a72c3be370a] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:07.761644 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aa1f24b0-d87a-4500-9e06-352e67cda41f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:07.762120 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aa1f24b0-d87a-4500-9e06-352e67cda41f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:07.763305 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aa1f24b0-d87a-4500-9e06-352e67cda41f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:07.763863 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aa1f24b0-d87a-4500-9e06-352e67cda41f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:07.842915 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-aa1f24b0-d87a-4500-9e06-352e67cda41f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:43:07.850464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-aa1f24b0-d87a-4500-9e06-352e67cda41f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a" status: 200 len: 1211 microversion: 2.1 time: 0.100473 Jul 15 15:43:07.851076 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 523/1040] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:43:07 2022] GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a => generated 1211 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:43:08.868260 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-217df9ad-6be8-4207-96d3-be8237dfc51d tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:43:08.868875 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-217df9ad-6be8-4207-96d3-be8237dfc51d tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 2973f7a5-3d6d-4aac-96d9-3a72c3be370a] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:08.875820 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-217df9ad-6be8-4207-96d3-be8237dfc51d tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:08.876260 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-217df9ad-6be8-4207-96d3-be8237dfc51d tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:08.877216 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-217df9ad-6be8-4207-96d3-be8237dfc51d tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:08.877639 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-217df9ad-6be8-4207-96d3-be8237dfc51d tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:09.061061 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-9d71f048-bd12-4826-bddc-af84c65fafd5 req-066a4a22-58b8-4b5a-9831-41bafeeab681 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2973f7a5-3d6d-4aac-96d9-3a72c3be370a", "tag": "4535b103-3842-4229-a1a3-7f29558cac2b"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:43:09.074119 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-9d71f048-bd12-4826-bddc-af84c65fafd5 req-066a4a22-58b8-4b5a-9831-41bafeeab681 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:09.074882 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-9d71f048-bd12-4826-bddc-af84c65fafd5 req-066a4a22-58b8-4b5a-9831-41bafeeab681 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:09.087594 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-9d71f048-bd12-4826-bddc-af84c65fafd5 req-066a4a22-58b8-4b5a-9831-41bafeeab681 service nova] Creating event network-changed:4535b103-3842-4229-a1a3-7f29558cac2b for instance 2973f7a5-3d6d-4aac-96d9-3a72c3be370a on hv-cinder-85001 Jul 15 15:43:09.094574 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-9d71f048-bd12-4826-bddc-af84c65fafd5 req-066a4a22-58b8-4b5a-9831-41bafeeab681 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117928 Jul 15 15:43:09.095170 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 524/1041] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:43:09.111414 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-217df9ad-6be8-4207-96d3-be8237dfc51d tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:43:09.119545 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-217df9ad-6be8-4207-96d3-be8237dfc51d tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a" status: 200 len: 1266 microversion: 2.1 time: 0.255134 Jul 15 15:43:09.120118 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 518/1042] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:43:08 2022] GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:43:10.138838 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b1eea161-1d4a-472b-b22c-2ae6d412cddd tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:43:10.139585 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b1eea161-1d4a-472b-b22c-2ae6d412cddd tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 2973f7a5-3d6d-4aac-96d9-3a72c3be370a] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:10.146805 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b1eea161-1d4a-472b-b22c-2ae6d412cddd tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:10.147292 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b1eea161-1d4a-472b-b22c-2ae6d412cddd tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:10.148059 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b1eea161-1d4a-472b-b22c-2ae6d412cddd tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:10.148492 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b1eea161-1d4a-472b-b22c-2ae6d412cddd tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:10.294550 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b1eea161-1d4a-472b-b22c-2ae6d412cddd tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:43:10.306035 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b1eea161-1d4a-472b-b22c-2ae6d412cddd tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a" status: 200 len: 1266 microversion: 2.1 time: 0.171463 Jul 15 15:43:10.306878 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 525/1043] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:43:10 2022] GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:43:11.324679 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-06299144-097f-4c02-8623-2fcb468607eb tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:43:11.325314 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-06299144-097f-4c02-8623-2fcb468607eb tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 2973f7a5-3d6d-4aac-96d9-3a72c3be370a] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:11.332977 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-06299144-097f-4c02-8623-2fcb468607eb tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:11.333416 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-06299144-097f-4c02-8623-2fcb468607eb tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:11.334207 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-06299144-097f-4c02-8623-2fcb468607eb tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:11.334673 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-06299144-097f-4c02-8623-2fcb468607eb tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:11.572764 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-06299144-097f-4c02-8623-2fcb468607eb tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:43:11.580894 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-06299144-097f-4c02-8623-2fcb468607eb tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a" status: 200 len: 1266 microversion: 2.1 time: 0.260154 Jul 15 15:43:11.581335 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 519/1044] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:43:11 2022] GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:43:12.598218 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f2968451-4aa8-4fe6-b533-6b0b99d30166 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:43:12.598900 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f2968451-4aa8-4fe6-b533-6b0b99d30166 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 2973f7a5-3d6d-4aac-96d9-3a72c3be370a] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:12.600874 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:43:12.607606 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f2968451-4aa8-4fe6-b533-6b0b99d30166 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:12.608037 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f2968451-4aa8-4fe6-b533-6b0b99d30166 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:12.608819 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f2968451-4aa8-4fe6-b533-6b0b99d30166 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:12.609238 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f2968451-4aa8-4fe6-b533-6b0b99d30166 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:12.763116 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f2968451-4aa8-4fe6-b533-6b0b99d30166 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:43:12.775128 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f2968451-4aa8-4fe6-b533-6b0b99d30166 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a" status: 200 len: 1266 microversion: 2.1 time: 0.180608 Jul 15 15:43:12.775861 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 526/1045] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:43:12 2022] GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:43:13.793034 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-64d3219e-d7d2-4595-8216-ac25af2b5447 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:43:13.793777 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-64d3219e-d7d2-4595-8216-ac25af2b5447 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 2973f7a5-3d6d-4aac-96d9-3a72c3be370a] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:13.801186 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-64d3219e-d7d2-4595-8216-ac25af2b5447 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:13.801630 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-64d3219e-d7d2-4595-8216-ac25af2b5447 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:13.802380 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-64d3219e-d7d2-4595-8216-ac25af2b5447 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:13.802839 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-64d3219e-d7d2-4595-8216-ac25af2b5447 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:13.947513 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-64d3219e-d7d2-4595-8216-ac25af2b5447 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:43:13.955572 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-64d3219e-d7d2-4595-8216-ac25af2b5447 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a" status: 200 len: 1266 microversion: 2.1 time: 0.166468 Jul 15 15:43:13.956136 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 520/1046] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:43:13 2022] GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:43:14.973306 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7d92d3f9-213a-4300-bedc-0d28fe5838e8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:43:14.973877 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7d92d3f9-213a-4300-bedc-0d28fe5838e8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 2973f7a5-3d6d-4aac-96d9-3a72c3be370a] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:14.981655 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7d92d3f9-213a-4300-bedc-0d28fe5838e8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:14.982107 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7d92d3f9-213a-4300-bedc-0d28fe5838e8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:14.983116 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7d92d3f9-213a-4300-bedc-0d28fe5838e8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:14.983540 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7d92d3f9-213a-4300-bedc-0d28fe5838e8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:15.129575 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7d92d3f9-213a-4300-bedc-0d28fe5838e8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:43:15.139085 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7d92d3f9-213a-4300-bedc-0d28fe5838e8 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a" status: 200 len: 1266 microversion: 2.1 time: 0.169483 Jul 15 15:43:15.139654 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 527/1047] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:43:14 2022] GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:43:16.160873 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-e541cede-eced-486b-8a0c-75caef99346d tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:43:16.161796 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-e541cede-eced-486b-8a0c-75caef99346d tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 2973f7a5-3d6d-4aac-96d9-3a72c3be370a] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:16.164650 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=4 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:43:16.173039 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e541cede-eced-486b-8a0c-75caef99346d tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:16.173469 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e541cede-eced-486b-8a0c-75caef99346d tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:16.174222 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e541cede-eced-486b-8a0c-75caef99346d tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:16.174675 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e541cede-eced-486b-8a0c-75caef99346d tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:16.320051 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e541cede-eced-486b-8a0c-75caef99346d tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:43:16.327961 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-e541cede-eced-486b-8a0c-75caef99346d tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a" status: 200 len: 1266 microversion: 2.1 time: 0.173996 Jul 15 15:43:16.328526 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 521/1048] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:43:16 2022] GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:43:17.347115 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0a4bfd30-fe69-49a1-ae1d-6c4351213bc5 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:43:17.347717 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-0a4bfd30-fe69-49a1-ae1d-6c4351213bc5 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 2973f7a5-3d6d-4aac-96d9-3a72c3be370a] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:17.349662 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=10 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:43:17.356165 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0a4bfd30-fe69-49a1-ae1d-6c4351213bc5 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:17.356946 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0a4bfd30-fe69-49a1-ae1d-6c4351213bc5 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:17.358176 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0a4bfd30-fe69-49a1-ae1d-6c4351213bc5 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:17.358735 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0a4bfd30-fe69-49a1-ae1d-6c4351213bc5 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:17.496057 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0a4bfd30-fe69-49a1-ae1d-6c4351213bc5 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:43:17.507817 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-0a4bfd30-fe69-49a1-ae1d-6c4351213bc5 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a" status: 200 len: 1266 microversion: 2.1 time: 0.165228 Jul 15 15:43:17.508578 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 528/1049] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:43:17 2022] GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:43:18.530491 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-b2602a08-47f2-40ed-bbd4-c49aab4f746e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:43:18.531142 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-b2602a08-47f2-40ed-bbd4-c49aab4f746e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 2973f7a5-3d6d-4aac-96d9-3a72c3be370a] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:18.538287 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b2602a08-47f2-40ed-bbd4-c49aab4f746e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:18.538762 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b2602a08-47f2-40ed-bbd4-c49aab4f746e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:18.539528 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b2602a08-47f2-40ed-bbd4-c49aab4f746e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:18.539956 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b2602a08-47f2-40ed-bbd4-c49aab4f746e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:18.679411 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b2602a08-47f2-40ed-bbd4-c49aab4f746e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:43:18.688472 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-b2602a08-47f2-40ed-bbd4-c49aab4f746e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a" status: 200 len: 1266 microversion: 2.1 time: 0.164050 Jul 15 15:43:18.689048 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 522/1050] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:43:18 2022] GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:43:19.705761 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5e3e7942-2ac9-45d6-b25f-e8da47993e32 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:43:19.706446 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5e3e7942-2ac9-45d6-b25f-e8da47993e32 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 2973f7a5-3d6d-4aac-96d9-3a72c3be370a] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:19.713893 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5e3e7942-2ac9-45d6-b25f-e8da47993e32 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:19.714995 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5e3e7942-2ac9-45d6-b25f-e8da47993e32 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:19.715173 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5e3e7942-2ac9-45d6-b25f-e8da47993e32 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:19.715628 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5e3e7942-2ac9-45d6-b25f-e8da47993e32 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:19.863199 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5e3e7942-2ac9-45d6-b25f-e8da47993e32 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:43:19.871505 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5e3e7942-2ac9-45d6-b25f-e8da47993e32 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a" status: 200 len: 1266 microversion: 2.1 time: 0.170344 Jul 15 15:43:19.872093 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 529/1051] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:43:19 2022] GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:43:20.888626 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-44e7cd6c-3d8f-4634-be3c-86bc5bfed3c1 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:43:20.889254 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-44e7cd6c-3d8f-4634-be3c-86bc5bfed3c1 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 2973f7a5-3d6d-4aac-96d9-3a72c3be370a] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:20.896199 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-44e7cd6c-3d8f-4634-be3c-86bc5bfed3c1 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:20.896611 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-44e7cd6c-3d8f-4634-be3c-86bc5bfed3c1 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:20.897392 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-44e7cd6c-3d8f-4634-be3c-86bc5bfed3c1 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:20.897820 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-44e7cd6c-3d8f-4634-be3c-86bc5bfed3c1 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:21.037825 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-44e7cd6c-3d8f-4634-be3c-86bc5bfed3c1 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:43:21.045474 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-44e7cd6c-3d8f-4634-be3c-86bc5bfed3c1 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a" status: 200 len: 1266 microversion: 2.1 time: 0.160793 Jul 15 15:43:21.046021 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 523/1052] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:43:20 2022] GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:43:21.993349 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-a2f8a8d5-fae5-43a1-b41b-2fd36eddfaa0 req-fd666adb-02f7-49af-a64a-2637fe13e0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2973f7a5-3d6d-4aac-96d9-3a72c3be370a", "name": "network-vif-plugged", "status": "completed", "tag": "4535b103-3842-4229-a1a3-7f29558cac2b"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:43:22.001932 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-a2f8a8d5-fae5-43a1-b41b-2fd36eddfaa0 req-fd666adb-02f7-49af-a64a-2637fe13e0e6 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:22.002372 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-a2f8a8d5-fae5-43a1-b41b-2fd36eddfaa0 req-fd666adb-02f7-49af-a64a-2637fe13e0e6 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:22.013676 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-a2f8a8d5-fae5-43a1-b41b-2fd36eddfaa0 req-fd666adb-02f7-49af-a64a-2637fe13e0e6 service nova] Creating event network-vif-plugged:4535b103-3842-4229-a1a3-7f29558cac2b for instance 2973f7a5-3d6d-4aac-96d9-3a72c3be370a on hv-cinder-85001 Jul 15 15:43:22.019057 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-a2f8a8d5-fae5-43a1-b41b-2fd36eddfaa0 req-fd666adb-02f7-49af-a64a-2637fe13e0e6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091866 Jul 15 15:43:22.019667 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 530/1053] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:43:22.067857 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-72acef56-6421-4097-a05e-58b4bdcba7c4 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:43:22.068457 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-72acef56-6421-4097-a05e-58b4bdcba7c4 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 2973f7a5-3d6d-4aac-96d9-3a72c3be370a] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:22.075421 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-72acef56-6421-4097-a05e-58b4bdcba7c4 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:22.075858 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-72acef56-6421-4097-a05e-58b4bdcba7c4 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:22.076607 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-72acef56-6421-4097-a05e-58b4bdcba7c4 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:22.077027 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-72acef56-6421-4097-a05e-58b4bdcba7c4 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:22.222874 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-72acef56-6421-4097-a05e-58b4bdcba7c4 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:43:22.230492 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-72acef56-6421-4097-a05e-58b4bdcba7c4 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a" status: 200 len: 1266 microversion: 2.1 time: 0.166586 Jul 15 15:43:22.231124 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 524/1054] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:43:22 2022] GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:43:23.250972 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1f2e9def-05ee-4071-936e-dec142f13908 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:43:23.251677 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1f2e9def-05ee-4071-936e-dec142f13908 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 2973f7a5-3d6d-4aac-96d9-3a72c3be370a] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:23.258658 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1f2e9def-05ee-4071-936e-dec142f13908 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:23.259133 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1f2e9def-05ee-4071-936e-dec142f13908 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:23.259895 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1f2e9def-05ee-4071-936e-dec142f13908 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:23.260346 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1f2e9def-05ee-4071-936e-dec142f13908 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:23.408573 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1f2e9def-05ee-4071-936e-dec142f13908 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:43:23.416560 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1f2e9def-05ee-4071-936e-dec142f13908 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a" status: 200 len: 1266 microversion: 2.1 time: 0.171659 Jul 15 15:43:23.417136 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 531/1055] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:43:23 2022] GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:43:24.436042 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-6d8f0c7a-826a-4c1f-8121-33f421af4af2 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:43:24.436679 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-6d8f0c7a-826a-4c1f-8121-33f421af4af2 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 2973f7a5-3d6d-4aac-96d9-3a72c3be370a] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:24.444724 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6d8f0c7a-826a-4c1f-8121-33f421af4af2 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:24.445175 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6d8f0c7a-826a-4c1f-8121-33f421af4af2 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:24.445934 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6d8f0c7a-826a-4c1f-8121-33f421af4af2 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:24.446365 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-6d8f0c7a-826a-4c1f-8121-33f421af4af2 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:24.598057 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-6d8f0c7a-826a-4c1f-8121-33f421af4af2 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:43:24.610115 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-6d8f0c7a-826a-4c1f-8121-33f421af4af2 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a" status: 200 len: 1266 microversion: 2.1 time: 0.177677 Jul 15 15:43:24.611008 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 525/1056] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:43:24 2022] GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:43:25.632974 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c1261902-2f07-4e5d-b0b4-17be022888ee tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:43:25.633600 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-c1261902-2f07-4e5d-b0b4-17be022888ee tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 2973f7a5-3d6d-4aac-96d9-3a72c3be370a] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:25.640551 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c1261902-2f07-4e5d-b0b4-17be022888ee tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:25.641523 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c1261902-2f07-4e5d-b0b4-17be022888ee tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:25.641964 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c1261902-2f07-4e5d-b0b4-17be022888ee tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:25.642395 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c1261902-2f07-4e5d-b0b4-17be022888ee tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:25.779877 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c1261902-2f07-4e5d-b0b4-17be022888ee tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:43:25.788205 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-c1261902-2f07-4e5d-b0b4-17be022888ee tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a" status: 200 len: 1453 microversion: 2.1 time: 0.159188 Jul 15 15:43:25.788751 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 532/1057] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:43:25 2022] GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:43:25.804898 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-c0056824-fd65-4ffd-8980-47679c527025 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:43:25.805468 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-c0056824-fd65-4ffd-8980-47679c527025 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 2973f7a5-3d6d-4aac-96d9-3a72c3be370a] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:25.812028 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c0056824-fd65-4ffd-8980-47679c527025 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:25.812476 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c0056824-fd65-4ffd-8980-47679c527025 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:25.813308 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c0056824-fd65-4ffd-8980-47679c527025 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:25.813741 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c0056824-fd65-4ffd-8980-47679c527025 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:25.954264 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-c0056824-fd65-4ffd-8980-47679c527025 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:43:25.962651 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-c0056824-fd65-4ffd-8980-47679c527025 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a" status: 200 len: 1453 microversion: 2.1 time: 0.161521 Jul 15 15:43:25.963244 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 526/1058] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:43:25 2022] GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:43:27.746817 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-3e6255e6-0028-489b-948f-ff679f556e0e req-e5303eb0-be5d-48a0-a525-76b6e349bcd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2973f7a5-3d6d-4aac-96d9-3a72c3be370a", "tag": "4535b103-3842-4229-a1a3-7f29558cac2b"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:43:27.755890 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-3e6255e6-0028-489b-948f-ff679f556e0e req-e5303eb0-be5d-48a0-a525-76b6e349bcd7 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:27.756303 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-3e6255e6-0028-489b-948f-ff679f556e0e req-e5303eb0-be5d-48a0-a525-76b6e349bcd7 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:27.767631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-3e6255e6-0028-489b-948f-ff679f556e0e req-e5303eb0-be5d-48a0-a525-76b6e349bcd7 service nova] Creating event network-changed:4535b103-3842-4229-a1a3-7f29558cac2b for instance 2973f7a5-3d6d-4aac-96d9-3a72c3be370a on hv-cinder-85001 Jul 15 15:43:27.772859 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-3e6255e6-0028-489b-948f-ff679f556e0e req-e5303eb0-be5d-48a0-a525-76b6e349bcd7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029600 Jul 15 15:43:27.773769 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 533/1059] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:43:55.287160 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-306fac2a-d5a9-4b6f-87ee-ba1dd1489b90 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:43:55.287867 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-306fac2a-d5a9-4b6f-87ee-ba1dd1489b90 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:55.291161 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=28 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:43:55.292096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=60 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:43:55.300427 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-306fac2a-d5a9-4b6f-87ee-ba1dd1489b90 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:55.301097 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-306fac2a-d5a9-4b6f-87ee-ba1dd1489b90 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:55.302264 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-306fac2a-d5a9-4b6f-87ee-ba1dd1489b90 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:55.302956 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-306fac2a-d5a9-4b6f-87ee-ba1dd1489b90 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:55.330999 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-306fac2a-d5a9-4b6f-87ee-ba1dd1489b90 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d/ips" status: 200 len: 150 microversion: 2.1 time: 0.052295 Jul 15 15:43:55.331581 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 527/1060] 10.222.0.40 () {58 vars in 1247 bytes} [Fri Jul 15 15:43:55 2022] GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d/ips => generated 150 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:43:55.339985 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:43:55.340725 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=56 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:43:55.344872 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-cfba5fdb-a009-4ce9-8356-6e1f72c621bb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9c61664-9ff3-4624-b487-a8494d7b7e57"}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:43:55.346006 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-cfba5fdb-a009-4ce9-8356-6e1f72c621bb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:55.353595 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cfba5fdb-a009-4ce9-8356-6e1f72c621bb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:55.354024 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cfba5fdb-a009-4ce9-8356-6e1f72c621bb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:55.354797 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cfba5fdb-a009-4ce9-8356-6e1f72c621bb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:55.355222 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cfba5fdb-a009-4ce9-8356-6e1f72c621bb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:55.436690 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-cfba5fdb-a009-4ce9-8356-6e1f72c621bb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] HTTP exception thrown: Invalid volume: volume d9c61664-9ff3-4624-b487-a8494d7b7e57 is already attached to instances: 21725c3f-9223-4166-ab4e-58710b60743b Jul 15 15:43:55.438398 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-cfba5fdb-a009-4ce9-8356-6e1f72c621bb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Request method failure captured: Jul 15 15:43:55.438398 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: POST /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d/os-volume_attachments HTTP/1.1 Jul 15 15:43:55.438398 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:43:55.438398 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:43:55.438398 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:43:55.438398 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 74 Jul 15 15:43:55.438398 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:43:55.438398 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:43:55.438398 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:43:55.438398 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:43:55.438398 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0Yo0oWCcSgXmtT-AIlDmriNhuaROhcBGq6ue3L5Dg2A5mO8AU2ZxmGGSNs4xSg3UmnfAZL6PFQuplQb5tQv5obCaLScXfj5NCn3_QAidbr64Xyr4O6TBJXZrgWdTGNpso6LO-VMt9Fp0ms130e_ZCnxRJ6cb7aFMSAyXq4JV2-p6SZA Jul 15 15:43:55.438398 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:43:55.438398 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:43:55.438398 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:43:55.438398 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:43:55.438398 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:43:55.438398 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:43:55.438398 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: 46caece212e44751ba83b3dbfc8176ee Jul 15 15:43:55.438398 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:43:55.438398 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:43:55.438398 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:43:55.440333 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_46caece212e44751ba83b3dbfc8176ee", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:43:55.440333 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:43:55.440333 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 46caece212e44751ba83b3dbfc8176ee Jul 15 15:43:55.440333 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:43:55.440333 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-AttachVolumeNegativeTest-461054684-project Jul 15 15:43:55.440333 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:43:55.440333 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:43:55.440333 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: 862f9a645a6f4ffe8c0518504ed6d47c Jul 15 15:43:55.440333 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-AttachVolumeNegativeTest-461054684-project Jul 15 15:43:55.440333 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Jul 15 15:43:55.440333 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {"volumeAttachment": {"volumeId": "d9c61664-9ff3-4624-b487-a8494d7b7e57"}} Jul 15 15:43:55.440333 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: > Jul 15 15:43:55.441939 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Invalid volume: volume d9c61664-9ff3-4624-b487-a8494d7b7e57 is already attached to instances: 21725c3f-9223-4166-ab4e-58710b60743b Jul 15 15:43:55.441939 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'server_id': '85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d', 'body': {'volumeAttachment': {'volumeId': 'd9c61664-9ff3-4624-b487-a8494d7b7e57'}}} Jul 15 15:43:55.441939 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:43:55.441939 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:43:55.441939 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 15 15:43:55.441939 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 15 15:43:55.441939 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 15 15:43:55.441939 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 15 15:43:55.441939 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 15 15:43:55.441939 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 15 15:43:55.441939 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 15 15:43:55.441939 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 15 15:43:55.441939 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 15 15:43:55.441939 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 15 15:43:55.441939 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d9c61664-9ff3-4624-b487-a8494d7b7e57 is already attached to instances: 21725c3f-9223-4166-ab4e-58710b60743b Jul 15 15:43:55.441939 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:43:55.441939 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:43:55.441939 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:43:55.441939 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:43:55.443546 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:43:55.443546 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:43:55.443546 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:43:55.443546 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:43:55.443546 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:43:55.443546 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:43:55.443546 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 15:43:55.443546 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 15:43:55.443546 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 15:43:55.443546 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 15:43:55.443546 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 15:43:55.443546 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 15:43:55.443546 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 15 15:43:55.443546 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 15 15:43:55.443546 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d9c61664-9ff3-4624-b487-a8494d7b7e57 is already attached to instances: 21725c3f-9223-4166-ab4e-58710b60743b Jul 15 15:43:55.443546 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:43:55.443546 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:43:55.443546 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:43:55.443546 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:43:55.443546 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:43:55.445425 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:43:55.445425 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:43:55.445425 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:43:55.445425 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d9c61664-9ff3-4624-b487-a8494d7b7e57 is already attached to instances: 21725c3f-9223-4166-ab4e-58710b60743b Jul 15 15:43:55.445425 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:43:55.445425 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-cfba5fdb-a009-4ce9-8356-6e1f72c621bb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Returning 400 to user: Invalid volume: volume d9c61664-9ff3-4624-b487-a8494d7b7e57 is already attached to instances: 21725c3f-9223-4166-ab4e-58710b60743b {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:43:55.445425 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-cfba5fdb-a009-4ce9-8356-6e1f72c621bb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "POST /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101436 Jul 15 15:43:55.445425 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 534/1061] 10.222.0.40 () {60 vars in 1322 bytes} [Fri Jul 15 15:43:55 2022] POST /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 15 15:43:55.449061 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-4fb26065-8b91-4d9f-89c8-ba87506bbb49 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:43:55.449546 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-4fb26065-8b91-4d9f-89c8-ba87506bbb49 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:55.455708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4fb26065-8b91-4d9f-89c8-ba87506bbb49 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:55.456480 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4fb26065-8b91-4d9f-89c8-ba87506bbb49 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:55.457027 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4fb26065-8b91-4d9f-89c8-ba87506bbb49 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:55.457449 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4fb26065-8b91-4d9f-89c8-ba87506bbb49 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:55.485850 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-4fb26065-8b91-4d9f-89c8-ba87506bbb49 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d] Going to try to terminate instance {{(pid=117999) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 15:43:55.568608 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-4fb26065-8b91-4d9f-89c8-ba87506bbb49 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "DELETE /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d" status: 204 len: 0 microversion: 2.1 time: 0.123030 Jul 15 15:43:55.569203 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 528/1062] 10.222.0.40 () {58 vars in 1238 bytes} [Fri Jul 15 15:43:55 2022] DELETE /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:43:55.577678 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e2a2cbb7-1ed2-46f2-8636-bad8005edcf2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:43:55.578358 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e2a2cbb7-1ed2-46f2-8636-bad8005edcf2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:55.585776 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e2a2cbb7-1ed2-46f2-8636-bad8005edcf2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:55.586208 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e2a2cbb7-1ed2-46f2-8636-bad8005edcf2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:55.586995 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e2a2cbb7-1ed2-46f2-8636-bad8005edcf2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:55.587413 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e2a2cbb7-1ed2-46f2-8636-bad8005edcf2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:55.722489 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e2a2cbb7-1ed2-46f2-8636-bad8005edcf2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:43:55.732529 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e2a2cbb7-1ed2-46f2-8636-bad8005edcf2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d" status: 200 len: 1683 microversion: 2.1 time: 0.158713 Jul 15 15:43:55.733091 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 535/1063] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:43:55 2022] GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:43:56.751539 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-e41d7306-c35d-4bcb-9c62-a82964a06299 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:43:56.752269 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-e41d7306-c35d-4bcb-9c62-a82964a06299 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:56.759486 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e41d7306-c35d-4bcb-9c62-a82964a06299 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:56.759932 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e41d7306-c35d-4bcb-9c62-a82964a06299 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:56.760697 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e41d7306-c35d-4bcb-9c62-a82964a06299 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:56.761126 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e41d7306-c35d-4bcb-9c62-a82964a06299 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:56.904199 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e41d7306-c35d-4bcb-9c62-a82964a06299 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:43:56.912336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-e41d7306-c35d-4bcb-9c62-a82964a06299 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d" status: 200 len: 1683 microversion: 2.1 time: 0.165183 Jul 15 15:43:56.912899 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 529/1064] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:43:56 2022] GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:43:57.930335 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7e0cc05a-8f56-4164-be8c-52598e52c677 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:43:57.930979 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7e0cc05a-8f56-4164-be8c-52598e52c677 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:57.942564 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7e0cc05a-8f56-4164-be8c-52598e52c677 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:57.942564 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7e0cc05a-8f56-4164-be8c-52598e52c677 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:57.945710 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7e0cc05a-8f56-4164-be8c-52598e52c677 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:57.945710 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7e0cc05a-8f56-4164-be8c-52598e52c677 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:58.186551 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7e0cc05a-8f56-4164-be8c-52598e52c677 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:43:58.194932 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7e0cc05a-8f56-4164-be8c-52598e52c677 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d" status: 200 len: 1683 microversion: 2.1 time: 0.269073 Jul 15 15:43:58.195584 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 536/1065] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:43:57 2022] GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d => generated 1683 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:43:58.210833 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-36bcc817-8e0c-40a9-8073-18dfda3e3886 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-483714152"}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:43:58.211423 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-36bcc817-8e0c-40a9-8073-18dfda3e3886 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:58.217991 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-36bcc817-8e0c-40a9-8073-18dfda3e3886 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:58.218434 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-36bcc817-8e0c-40a9-8073-18dfda3e3886 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:58.219271 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-36bcc817-8e0c-40a9-8073-18dfda3e3886 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:58.219735 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-36bcc817-8e0c-40a9-8073-18dfda3e3886 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:58.454278 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.network.security_group_api [None req-36bcc817-8e0c-40a9-8073-18dfda3e3886 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Removing security group 82d6c3a0-1e0e-4534-8b53-9274d0ea1b25 from port 1fa2eb43-8651-449a-adde-4193c18db06c Jul 15 15:43:59.117638 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-36bcc817-8e0c-40a9-8073-18dfda3e3886 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "POST /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca/action" status: 202 len: 0 microversion: 2.1 time: 0.911022 Jul 15 15:43:59.118300 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 530/1066] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 15 15:43:58 2022] POST /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca/action => generated 0 bytes in 913 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:43:59.131367 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-92af82a7-285a-4590-947c-d0c989a35fd7 req-4bcdd237-bf2b-48a2-9cff-537f3340edda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c767fdb-5253-437d-8856-2c5a8934d8ca", "tag": "1fa2eb43-8651-449a-adde-4193c18db06c"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:43:59.143520 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-92af82a7-285a-4590-947c-d0c989a35fd7 req-4bcdd237-bf2b-48a2-9cff-537f3340edda service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:59.144357 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-92af82a7-285a-4590-947c-d0c989a35fd7 req-4bcdd237-bf2b-48a2-9cff-537f3340edda service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:59.166354 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-92af82a7-285a-4590-947c-d0c989a35fd7 req-4bcdd237-bf2b-48a2-9cff-537f3340edda service nova] Creating event network-changed:1fa2eb43-8651-449a-adde-4193c18db06c for instance 3c767fdb-5253-437d-8856-2c5a8934d8ca on hv-cinder-85001 Jul 15 15:43:59.177828 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-92af82a7-285a-4590-947c-d0c989a35fd7 req-4bcdd237-bf2b-48a2-9cff-537f3340edda service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053243 Jul 15 15:43:59.178903 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 537/1067] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:43:59.213897 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-a9be7ea9-cb8c-421e-8c18-fac7e10453c4 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:43:59.214731 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-a9be7ea9-cb8c-421e-8c18-fac7e10453c4 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:43:59.226330 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a9be7ea9-cb8c-421e-8c18-fac7e10453c4 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:59.227051 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a9be7ea9-cb8c-421e-8c18-fac7e10453c4 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:59.230212 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a9be7ea9-cb8c-421e-8c18-fac7e10453c4 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:43:59.231764 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a9be7ea9-cb8c-421e-8c18-fac7e10453c4 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:43:59.431072 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-a9be7ea9-cb8c-421e-8c18-fac7e10453c4 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:43:59.442590 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-a9be7ea9-cb8c-421e-8c18-fac7e10453c4 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d" status: 200 len: 1327 microversion: 2.1 time: 0.233625 Jul 15 15:43:59.444200 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 531/1068] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:43:59 2022] GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d => generated 1327 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:44:00.351494 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4895b573-1b40-4e8f-9f63-b0fa42651739 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:00.352815 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-4895b573-1b40-4e8f-9f63-b0fa42651739 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:00.355728 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-d19650a6-5587-4d2d-ac67-496f893b23ff req-dbbb67cc-a9e3-406e-9cde-d71b276341b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c767fdb-5253-437d-8856-2c5a8934d8ca", "tag": "1fa2eb43-8651-449a-adde-4193c18db06c"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:44:00.362573 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4895b573-1b40-4e8f-9f63-b0fa42651739 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:00.363385 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4895b573-1b40-4e8f-9f63-b0fa42651739 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:00.364606 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4895b573-1b40-4e8f-9f63-b0fa42651739 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:00.365247 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4895b573-1b40-4e8f-9f63-b0fa42651739 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:00.366834 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-d19650a6-5587-4d2d-ac67-496f893b23ff req-dbbb67cc-a9e3-406e-9cde-d71b276341b4 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:00.367476 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-d19650a6-5587-4d2d-ac67-496f893b23ff req-dbbb67cc-a9e3-406e-9cde-d71b276341b4 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:00.381878 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-d19650a6-5587-4d2d-ac67-496f893b23ff req-dbbb67cc-a9e3-406e-9cde-d71b276341b4 service nova] Creating event network-changed:1fa2eb43-8651-449a-adde-4193c18db06c for instance 3c767fdb-5253-437d-8856-2c5a8934d8ca on hv-cinder-85001 Jul 15 15:44:00.389624 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-d19650a6-5587-4d2d-ac67-496f893b23ff req-dbbb67cc-a9e3-406e-9cde-d71b276341b4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037628 Jul 15 15:44:00.390232 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 532/1069] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:44:00.461442 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-df5d01da-4d8c-4920-859a-f869892cfc9d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:00.462300 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-df5d01da-4d8c-4920-859a-f869892cfc9d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:00.476169 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.objects.instance [None req-4895b573-1b40-4e8f-9f63-b0fa42651739 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lazy-loading 'services' on Instance uuid 3c767fdb-5253-437d-8856-2c5a8934d8ca {{(pid=117998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:44:00.476686 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-df5d01da-4d8c-4920-859a-f869892cfc9d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:00.479464 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-df5d01da-4d8c-4920-859a-f869892cfc9d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:00.480633 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-df5d01da-4d8c-4920-859a-f869892cfc9d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:00.481245 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-df5d01da-4d8c-4920-859a-f869892cfc9d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:00.498628 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.wsgi [None req-df5d01da-4d8c-4920-859a-f869892cfc9d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] HTTP exception thrown: Instance 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d could not be found. Jul 15 15:44:00.500538 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-df5d01da-4d8c-4920-859a-f869892cfc9d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Request method failure captured: Jul 15 15:44:00.500538 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: request: GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d HTTP/1.1 Jul 15 15:44:00.500538 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept: application/json Jul 15 15:44:00.500538 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept-Encoding: identity Jul 15 15:44:00.500538 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Connection: close Jul 15 15:44:00.500538 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Length: 0 Jul 15 15:44:00.500538 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Type: application/json Jul 15 15:44:00.500538 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Host: 10.222.0.40 Jul 15 15:44:00.500538 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Openstack-System-Scope: None Jul 15 15:44:00.500538 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: User-Agent: python-urllib3/1.26.9 Jul 15 15:44:00.500538 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Auth-Token: gAAAAABi0Yo0oWCcSgXmtT-AIlDmriNhuaROhcBGq6ue3L5Dg2A5mO8AU2ZxmGGSNs4xSg3UmnfAZL6PFQuplQb5tQv5obCaLScXfj5NCn3_QAidbr64Xyr4O6TBJXZrgWdTGNpso6LO-VMt9Fp0ms130e_ZCnxRJ6cb7aFMSAyXq4JV2-p6SZA Jul 15 15:44:00.500538 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Id: None Jul 15 15:44:00.500538 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Name: None Jul 15 15:44:00.500538 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Identity-Status: Confirmed Jul 15 15:44:00.500538 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Is-Admin-Project: True Jul 15 15:44:00.500538 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Id: default Jul 15 15:44:00.500538 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Name: Default Jul 15 15:44:00.500538 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Id: 46caece212e44751ba83b3dbfc8176ee Jul 15 15:44:00.500538 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Name: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:44:00.500538 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Role: member,reader Jul 15 15:44:00.500538 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Roles: member,reader Jul 15 15:44:00.502246 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_46caece212e44751ba83b3dbfc8176ee", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:44:00.502246 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:44:00.502246 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Id: 46caece212e44751ba83b3dbfc8176ee Jul 15 15:44:00.502246 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:44:00.502246 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User: tempest-AttachVolumeNegativeTest-461054684-project Jul 15 15:44:00.502246 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Id: default Jul 15 15:44:00.502246 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Name: Default Jul 15 15:44:00.502246 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Id: 862f9a645a6f4ffe8c0518504ed6d47c Jul 15 15:44:00.502246 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Name: tempest-AttachVolumeNegativeTest-461054684-project Jul 15 15:44:00.502246 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: method: > Jul 15 15:44:00.502246 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: exception: Instance 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d could not be found. Jul 15 15:44:00.502246 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: action_args: {'id': '85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d'} Jul 15 15:44:00.503350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:44:00.503350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:44:00.503350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:44:00.503350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:44:00.503350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:44:00.503350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:44:00.503350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:44:00.503350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:44:00.503350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:44:00.503350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:44:00.503350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d could not be found. Jul 15 15:44:00.503350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:44:00.503350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:44:00.503350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:44:00.503350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:44:00.503350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:44:00.503350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:44:00.503350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:44:00.503350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:44:00.503350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:44:00.504991 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:44:00.504991 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:44:00.504991 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:44:00.504991 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:44:00.504991 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:44:00.504991 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:44:00.504991 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:44:00.504991 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d could not be found. Jul 15 15:44:00.504991 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:44:00.504991 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:44:00.504991 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:44:00.504991 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:44:00.504991 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:44:00.504991 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:44:00.504991 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:44:00.504991 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:44:00.504991 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d could not be found. Jul 15 15:44:00.504991 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:44:00.507324 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-df5d01da-4d8c-4920-859a-f869892cfc9d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Returning 404 to user: Instance 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d could not be found. {{(pid=117999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:44:00.508370 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-df5d01da-4d8c-4920-859a-f869892cfc9d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d" status: 404 len: 111 microversion: 2.1 time: 0.051281 Jul 15 15:44:00.509418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 533/1070] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:44:00 2022] GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:44:00.525848 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-aa9f8e88-0594-45ad-a98f-08aacc4f0f85 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '.version_select at 0x7fe3c671c940>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:00.529438 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR oslo.messaging._drivers.impl_rabbit [None req-aa9f8e88-0594-45ad-a98f-08aacc4f0f85 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [ec96e912-1e7c-450c-80a7-5f919cdd4297] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 15 15:44:00.606552 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4895b573-1b40-4e8f-9f63-b0fa42651739 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca/os-volume_attachments/99b1f280-400c-4892-9a9d-2ce9bcdf246a" status: 202 len: 0 microversion: 2.1 time: 0.259443 Jul 15 15:44:00.607400 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 538/1071] 10.222.0.40 () {58 vars in 1415 bytes} [Fri Jul 15 15:44:00 2022] DELETE /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca/os-volume_attachments/99b1f280-400c-4892-9a9d-2ce9bcdf246a => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:44:00.617890 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2a4ab977-c46b-4a3f-bb79-3da004b7f4ad tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:00.620272 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-2a4ab977-c46b-4a3f-bb79-3da004b7f4ad tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:00.633170 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2a4ab977-c46b-4a3f-bb79-3da004b7f4ad tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:00.634051 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2a4ab977-c46b-4a3f-bb79-3da004b7f4ad tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:00.635080 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2a4ab977-c46b-4a3f-bb79-3da004b7f4ad tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:00.636037 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2a4ab977-c46b-4a3f-bb79-3da004b7f4ad tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:00.687360 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-2a4ab977-c46b-4a3f-bb79-3da004b7f4ad tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074253 Jul 15 15:44:00.690769 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 539/1072] 10.222.0.40 () {58 vars in 1301 bytes} [Fri Jul 15 15:44:00 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:44:01.193647 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-8b9e743a-9ae6-4081-ad58-69eb38102f97 req-722f0e73-0a6d-4f7e-ac9b-8ffb2a577a7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d", "name": "network-vif-deleted", "tag": "ff327a59-ca88-4701-a612-4a72e896a4b2"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:44:01.202774 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-8b9e743a-9ae6-4081-ad58-69eb38102f97 req-722f0e73-0a6d-4f7e-ac9b-8ffb2a577a7b service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:01.203570 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-8b9e743a-9ae6-4081-ad58-69eb38102f97 req-722f0e73-0a6d-4f7e-ac9b-8ffb2a577a7b service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:01.218089 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-8b9e743a-9ae6-4081-ad58-69eb38102f97 req-722f0e73-0a6d-4f7e-ac9b-8ffb2a577a7b service nova] Creating event network-vif-deleted:ff327a59-ca88-4701-a612-4a72e896a4b2 for instance 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d on hv-cinder-85001 Jul 15 15:44:01.224396 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-8b9e743a-9ae6-4081-ad58-69eb38102f97 req-722f0e73-0a6d-4f7e-ac9b-8ffb2a577a7b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034150 Jul 15 15:44:01.225257 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 540/1073] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:44:01.537916 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO oslo.messaging._drivers.impl_rabbit [None req-aa9f8e88-0594-45ad-a98f-08aacc4f0f85 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [ec96e912-1e7c-450c-80a7-5f919cdd4297] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 46350. Jul 15 15:44:01.560381 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-aa9f8e88-0594-45ad-a98f-08aacc4f0f85 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1660197882" status: 202 len: 0 microversion: 2.1 time: 1.044061 Jul 15 15:44:01.560953 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 534/1074] 10.222.0.40 () {58 vars in 1220 bytes} [Fri Jul 15 15:44:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1660197882 => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:44:01.704831 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0df0a05b-c987-4d81-ba42-1cc06004ac69 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:01.706713 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-0df0a05b-c987-4d81-ba42-1cc06004ac69 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:01.714866 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0df0a05b-c987-4d81-ba42-1cc06004ac69 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:01.715328 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0df0a05b-c987-4d81-ba42-1cc06004ac69 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:01.716115 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0df0a05b-c987-4d81-ba42-1cc06004ac69 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:01.716540 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0df0a05b-c987-4d81-ba42-1cc06004ac69 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:01.752560 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-0df0a05b-c987-4d81-ba42-1cc06004ac69 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053895 Jul 15 15:44:01.753860 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 541/1075] 10.222.0.40 () {58 vars in 1301 bytes} [Fri Jul 15 15:44:01 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 15:44:01.764597 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-48bafb55-91e2-4ecb-a6de-c2ab0113ddfb tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:01.765124 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-48bafb55-91e2-4ecb-a6de-c2ab0113ddfb tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:01.771821 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-48bafb55-91e2-4ecb-a6de-c2ab0113ddfb tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:01.772527 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-48bafb55-91e2-4ecb-a6de-c2ab0113ddfb tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:01.773535 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-48bafb55-91e2-4ecb-a6de-c2ab0113ddfb tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:01.773967 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-48bafb55-91e2-4ecb-a6de-c2ab0113ddfb tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:01.861822 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.wsgi [None req-48bafb55-91e2-4ecb-a6de-c2ab0113ddfb tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] HTTP exception thrown: Instance 3c767fdb-5253-437d-8856-2c5a8934d8ca is not attached to volume 99b1f280-400c-4892-9a9d-2ce9bcdf246a Jul 15 15:44:01.864202 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-48bafb55-91e2-4ecb-a6de-c2ab0113ddfb tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Request method failure captured: Jul 15 15:44:01.864202 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: request: DELETE /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca/os-volume_attachments/99b1f280-400c-4892-9a9d-2ce9bcdf246a HTTP/1.1 Jul 15 15:44:01.864202 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept: application/json Jul 15 15:44:01.864202 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept-Encoding: identity Jul 15 15:44:01.864202 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Connection: close Jul 15 15:44:01.864202 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Length: 0 Jul 15 15:44:01.864202 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Type: application/json Jul 15 15:44:01.864202 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Host: 10.222.0.40 Jul 15 15:44:01.864202 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Openstack-System-Scope: None Jul 15 15:44:01.864202 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: User-Agent: python-urllib3/1.26.9 Jul 15 15:44:01.864202 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Auth-Token: gAAAAABi0YpKE0E1i4nj7JNw6pHftfCFmmLlACMfDv7r1aIL_PQ7sExCh2wisWhOSS-dAp2A8TuXHj1G9I1P3XzBVJNEaNwWIAo2zaC8Hihy3W4-he1-owmOJuVWFa00ePKI4llIvU9iRvvqySxwVhFAhYJu7g3EzwG3NILw_H6Iubm16P2-_Q4 Jul 15 15:44:01.864202 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Id: None Jul 15 15:44:01.864202 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Name: None Jul 15 15:44:01.864202 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Identity-Status: Confirmed Jul 15 15:44:01.864202 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Is-Admin-Project: True Jul 15 15:44:01.864202 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Id: default Jul 15 15:44:01.864202 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Name: Default Jul 15 15:44:01.864202 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Id: 25f10e8177434ab69a22f1270cd8d0db Jul 15 15:44:01.864202 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Name: tempest-TestMinimumBasicScenario-1750869290 Jul 15 15:44:01.864202 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Role: member,reader Jul 15 15:44:01.864202 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Roles: member,reader Jul 15 15:44:01.866626 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/25f10e8177434ab69a22f1270cd8d0db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_25f10e8177434ab69a22f1270cd8d0db", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/25f10e8177434ab69a22f1270cd8d0db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/25f10e8177434ab69a22f1270cd8d0db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:44:01.866626 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant: tempest-TestMinimumBasicScenario-1750869290 Jul 15 15:44:01.866626 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Id: 25f10e8177434ab69a22f1270cd8d0db Jul 15 15:44:01.866626 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1750869290 Jul 15 15:44:01.866626 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User: tempest-TestMinimumBasicScenario-1750869290-project Jul 15 15:44:01.866626 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Id: default Jul 15 15:44:01.866626 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Name: Default Jul 15 15:44:01.866626 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Id: 41e56871077745d18a51c2855a48cb7a Jul 15 15:44:01.866626 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Name: tempest-TestMinimumBasicScenario-1750869290-project Jul 15 15:44:01.866626 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: method: > Jul 15 15:44:01.866626 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: exception: Instance 3c767fdb-5253-437d-8856-2c5a8934d8ca is not attached to volume 99b1f280-400c-4892-9a9d-2ce9bcdf246a Jul 15 15:44:01.867575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: action_args: {'server_id': '3c767fdb-5253-437d-8856-2c5a8934d8ca', 'id': '99b1f280-400c-4892-9a9d-2ce9bcdf246a'} Jul 15 15:44:01.867575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:44:01.867575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:44:01.867575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 15 15:44:01.867575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 15 15:44:01.867575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 15:44:01.867575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 15:44:01.867575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 15 15:44:01.867575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 15 15:44:01.867575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 99b1f280-400c-4892-9a9d-2ce9bcdf246a. Jul 15 15:44:01.867575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:44:01.867575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:44:01.867575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:44:01.867575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:44:01.867575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:44:01.867575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:44:01.867575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:44:01.867575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:44:01.867575 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:44:01.869351 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:44:01.869351 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 15 15:44:01.869351 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 15 15:44:01.869351 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c767fdb-5253-437d-8856-2c5a8934d8ca is not attached to volume 99b1f280-400c-4892-9a9d-2ce9bcdf246a Jul 15 15:44:01.869351 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:44:01.869351 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:44:01.869351 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:44:01.869351 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:44:01.869351 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:44:01.869351 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:44:01.869351 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:44:01.869351 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:44:01.869351 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c767fdb-5253-437d-8856-2c5a8934d8ca is not attached to volume 99b1f280-400c-4892-9a9d-2ce9bcdf246a Jul 15 15:44:01.869351 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:44:01.869351 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-48bafb55-91e2-4ecb-a6de-c2ab0113ddfb tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Returning 404 to user: Instance 3c767fdb-5253-437d-8856-2c5a8934d8ca is not attached to volume 99b1f280-400c-4892-9a9d-2ce9bcdf246a {{(pid=117999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:44:01.870879 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-48bafb55-91e2-4ecb-a6de-c2ab0113ddfb tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca/os-volume_attachments/99b1f280-400c-4892-9a9d-2ce9bcdf246a" status: 404 len: 154 microversion: 2.1 time: 0.105308 Jul 15 15:44:01.870879 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 535/1076] 10.222.0.40 () {58 vars in 1415 bytes} [Fri Jul 15 15:44:01 2022] DELETE /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca/os-volume_attachments/99b1f280-400c-4892-9a9d-2ce9bcdf246a => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:44:02.578208 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9b1be0f5-6c3c-4ea1-ad72-17c43c87aeae tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:02.578717 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9b1be0f5-6c3c-4ea1-ad72-17c43c87aeae tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:02.585633 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9b1be0f5-6c3c-4ea1-ad72-17c43c87aeae tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:02.586069 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9b1be0f5-6c3c-4ea1-ad72-17c43c87aeae tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:02.587014 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9b1be0f5-6c3c-4ea1-ad72-17c43c87aeae tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:02.587426 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9b1be0f5-6c3c-4ea1-ad72-17c43c87aeae tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:02.670128 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.objects.instance [None req-9b1be0f5-6c3c-4ea1-ad72-17c43c87aeae tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lazy-loading 'services' on Instance uuid 21725c3f-9223-4166-ab4e-58710b60743b {{(pid=117998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:44:02.745455 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9b1be0f5-6c3c-4ea1-ad72-17c43c87aeae tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "DELETE /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b/os-volume_attachments/d9c61664-9ff3-4624-b487-a8494d7b7e57" status: 202 len: 0 microversion: 2.1 time: 0.171094 Jul 15 15:44:02.746233 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 542/1077] 10.222.0.40 () {58 vars in 1415 bytes} [Fri Jul 15 15:44:02 2022] DELETE /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b/os-volume_attachments/d9c61664-9ff3-4624-b487-a8494d7b7e57 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:44:02.755740 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-98051208-66c3-47fd-97ae-ff0e841adffa tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:02.756720 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-98051208-66c3-47fd-97ae-ff0e841adffa tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:02.763511 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-98051208-66c3-47fd-97ae-ff0e841adffa tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:02.763990 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-98051208-66c3-47fd-97ae-ff0e841adffa tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:02.764765 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-98051208-66c3-47fd-97ae-ff0e841adffa tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:02.765287 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-98051208-66c3-47fd-97ae-ff0e841adffa tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:02.804573 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-98051208-66c3-47fd-97ae-ff0e841adffa tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053751 Jul 15 15:44:02.805265 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 536/1078] 10.222.0.40 () {58 vars in 1301 bytes} [Fri Jul 15 15:44:02 2022] GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:44:03.014049 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4e92170f-cdc2-42cb-98cf-176e4dc4da44 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:03.014677 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-4e92170f-cdc2-42cb-98cf-176e4dc4da44 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:03.021830 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4e92170f-cdc2-42cb-98cf-176e4dc4da44 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:03.022272 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4e92170f-cdc2-42cb-98cf-176e4dc4da44 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:03.023077 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4e92170f-cdc2-42cb-98cf-176e4dc4da44 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:03.023512 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4e92170f-cdc2-42cb-98cf-176e4dc4da44 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:03.048750 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-4e92170f-cdc2-42cb-98cf-176e4dc4da44 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Going to try to terminate instance {{(pid=117998) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 15:44:03.130465 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4e92170f-cdc2-42cb-98cf-176e4dc4da44 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 204 len: 0 microversion: 2.1 time: 0.120377 Jul 15 15:44:03.131072 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 543/1079] 10.222.0.40 () {58 vars in 1238 bytes} [Fri Jul 15 15:44:03 2022] DELETE /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:44:03.139507 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-c6b4231e-7705-4e56-a722-dc739fa08494 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:03.140103 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-c6b4231e-7705-4e56-a722-dc739fa08494 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:03.146343 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c6b4231e-7705-4e56-a722-dc739fa08494 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:03.146849 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c6b4231e-7705-4e56-a722-dc739fa08494 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:03.147599 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c6b4231e-7705-4e56-a722-dc739fa08494 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:03.148143 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c6b4231e-7705-4e56-a722-dc739fa08494 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:03.284244 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-c6b4231e-7705-4e56-a722-dc739fa08494 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:44:03.291883 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-c6b4231e-7705-4e56-a722-dc739fa08494 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1554 microversion: 2.1 time: 0.156312 Jul 15 15:44:03.292478 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 537/1080] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:44:03 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:44:03.818134 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a194deb7-8507-44da-89a0-6ee619772b4f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:03.819171 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a194deb7-8507-44da-89a0-6ee619772b4f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:03.826938 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a194deb7-8507-44da-89a0-6ee619772b4f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:03.827404 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a194deb7-8507-44da-89a0-6ee619772b4f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:03.828187 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a194deb7-8507-44da-89a0-6ee619772b4f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:03.828603 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a194deb7-8507-44da-89a0-6ee619772b4f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:03.859273 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a194deb7-8507-44da-89a0-6ee619772b4f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045617 Jul 15 15:44:03.860102 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 544/1081] 10.222.0.40 () {58 vars in 1301 bytes} [Fri Jul 15 15:44:03 2022] GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:44:04.309871 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-e44e6d33-6be5-4147-bdba-bd8c42f1338c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:04.310466 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-e44e6d33-6be5-4147-bdba-bd8c42f1338c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:04.317622 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e44e6d33-6be5-4147-bdba-bd8c42f1338c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:04.318061 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e44e6d33-6be5-4147-bdba-bd8c42f1338c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:04.318863 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e44e6d33-6be5-4147-bdba-bd8c42f1338c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:04.319283 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e44e6d33-6be5-4147-bdba-bd8c42f1338c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:04.451709 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e44e6d33-6be5-4147-bdba-bd8c42f1338c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:44:04.459955 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-e44e6d33-6be5-4147-bdba-bd8c42f1338c tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1554 microversion: 2.1 time: 0.154051 Jul 15 15:44:04.460534 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 538/1082] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:44:04 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:44:04.871652 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-dc615593-585b-43e6-ab02-cd761af5e422 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:04.872472 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-dc615593-585b-43e6-ab02-cd761af5e422 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:04.879396 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dc615593-585b-43e6-ab02-cd761af5e422 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:04.879834 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dc615593-585b-43e6-ab02-cd761af5e422 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:04.880587 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dc615593-585b-43e6-ab02-cd761af5e422 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:04.881006 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dc615593-585b-43e6-ab02-cd761af5e422 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:04.911842 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-dc615593-585b-43e6-ab02-cd761af5e422 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044158 Jul 15 15:44:04.912473 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 545/1083] 10.222.0.40 () {58 vars in 1301 bytes} [Fri Jul 15 15:44:04 2022] GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:44:05.477730 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-ed9b28ff-6fca-492d-b295-88e6b2a312ae tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:05.478361 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-ed9b28ff-6fca-492d-b295-88e6b2a312ae tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:05.485975 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ed9b28ff-6fca-492d-b295-88e6b2a312ae tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:05.486417 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ed9b28ff-6fca-492d-b295-88e6b2a312ae tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:05.487409 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ed9b28ff-6fca-492d-b295-88e6b2a312ae tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:05.487850 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ed9b28ff-6fca-492d-b295-88e6b2a312ae tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:05.625360 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-ed9b28ff-6fca-492d-b295-88e6b2a312ae tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:44:05.634037 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-ed9b28ff-6fca-492d-b295-88e6b2a312ae tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1554 microversion: 2.1 time: 0.160292 Jul 15 15:44:05.634628 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 539/1084] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:44:05 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:44:05.923737 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9fe737fe-2f64-42ac-bfcf-2dc755ebe611 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:05.924661 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9fe737fe-2f64-42ac-bfcf-2dc755ebe611 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:05.932009 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9fe737fe-2f64-42ac-bfcf-2dc755ebe611 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:05.932447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9fe737fe-2f64-42ac-bfcf-2dc755ebe611 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:05.933215 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9fe737fe-2f64-42ac-bfcf-2dc755ebe611 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:05.933638 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9fe737fe-2f64-42ac-bfcf-2dc755ebe611 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:05.968359 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9fe737fe-2f64-42ac-bfcf-2dc755ebe611 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048543 Jul 15 15:44:05.968957 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 546/1085] 10.222.0.40 () {58 vars in 1301 bytes} [Fri Jul 15 15:44:05 2022] GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 15:44:06.028171 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-5420ef39-31e9-4ce7-b67b-bac9d2abfb58 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:06.028749 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-5420ef39-31e9-4ce7-b67b-bac9d2abfb58 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:06.035505 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5420ef39-31e9-4ce7-b67b-bac9d2abfb58 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:06.035965 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5420ef39-31e9-4ce7-b67b-bac9d2abfb58 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:06.036732 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5420ef39-31e9-4ce7-b67b-bac9d2abfb58 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:06.037166 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5420ef39-31e9-4ce7-b67b-bac9d2abfb58 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:06.063824 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-5420ef39-31e9-4ce7-b67b-bac9d2abfb58 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Going to try to terminate instance {{(pid=117999) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 15:44:06.161069 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-5420ef39-31e9-4ce7-b67b-bac9d2abfb58 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "DELETE /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b" status: 204 len: 0 microversion: 2.1 time: 0.136336 Jul 15 15:44:06.161967 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 540/1086] 10.222.0.40 () {58 vars in 1238 bytes} [Fri Jul 15 15:44:06 2022] DELETE /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:44:06.170307 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-53fd1172-0fe9-44d5-bf4b-8cd797853d7e tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:06.171079 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-53fd1172-0fe9-44d5-bf4b-8cd797853d7e tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:06.178430 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-53fd1172-0fe9-44d5-bf4b-8cd797853d7e tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:06.178947 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-53fd1172-0fe9-44d5-bf4b-8cd797853d7e tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:06.180083 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-53fd1172-0fe9-44d5-bf4b-8cd797853d7e tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:06.180509 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-53fd1172-0fe9-44d5-bf4b-8cd797853d7e tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:06.204119 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-97df47e6-7e65-4f47-b3f9-cbed932bc844 req-61e25c66-12f6-403b-aa4a-2ee0d00b6883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c767fdb-5253-437d-8856-2c5a8934d8ca", "name": "network-vif-deleted", "tag": "1fa2eb43-8651-449a-adde-4193c18db06c"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:44:06.213467 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-97df47e6-7e65-4f47-b3f9-cbed932bc844 req-61e25c66-12f6-403b-aa4a-2ee0d00b6883 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:06.214983 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-97df47e6-7e65-4f47-b3f9-cbed932bc844 req-61e25c66-12f6-403b-aa4a-2ee0d00b6883 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:06.227164 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-97df47e6-7e65-4f47-b3f9-cbed932bc844 req-61e25c66-12f6-403b-aa4a-2ee0d00b6883 service nova] Creating event network-vif-deleted:1fa2eb43-8651-449a-adde-4193c18db06c for instance 3c767fdb-5253-437d-8856-2c5a8934d8ca on hv-cinder-85001 Jul 15 15:44:06.232104 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-97df47e6-7e65-4f47-b3f9-cbed932bc844 req-61e25c66-12f6-403b-aa4a-2ee0d00b6883 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032015 Jul 15 15:44:06.232829 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 541/1087] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:44:06.321306 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-53fd1172-0fe9-44d5-bf4b-8cd797853d7e tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:44:06.329359 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-53fd1172-0fe9-44d5-bf4b-8cd797853d7e tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b" status: 200 len: 1683 microversion: 2.1 time: 0.162872 Jul 15 15:44:06.329967 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 547/1088] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:44:06 2022] GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:44:06.653354 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-162f70fb-14e2-4917-954f-7468a88cb58b tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:06.654083 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-162f70fb-14e2-4917-954f-7468a88cb58b tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:06.661074 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-162f70fb-14e2-4917-954f-7468a88cb58b tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:06.661517 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-162f70fb-14e2-4917-954f-7468a88cb58b tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:06.662284 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-162f70fb-14e2-4917-954f-7468a88cb58b tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:06.662760 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-162f70fb-14e2-4917-954f-7468a88cb58b tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:06.733098 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-162f70fb-14e2-4917-954f-7468a88cb58b tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:44:06.741558 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-162f70fb-14e2-4917-954f-7468a88cb58b tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1512 microversion: 2.1 time: 0.092822 Jul 15 15:44:06.742026 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 542/1089] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:44:06 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1512 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:44:07.354389 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a9994df4-7492-43a5-a76b-cf7cd4ef0bf9 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:07.355054 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a9994df4-7492-43a5-a76b-cf7cd4ef0bf9 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:07.362279 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a9994df4-7492-43a5-a76b-cf7cd4ef0bf9 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:07.363652 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a9994df4-7492-43a5-a76b-cf7cd4ef0bf9 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:07.364037 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a9994df4-7492-43a5-a76b-cf7cd4ef0bf9 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:07.364465 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a9994df4-7492-43a5-a76b-cf7cd4ef0bf9 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:07.512258 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a9994df4-7492-43a5-a76b-cf7cd4ef0bf9 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:44:07.516004 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:44:07.523682 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a9994df4-7492-43a5-a76b-cf7cd4ef0bf9 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b" status: 200 len: 1683 microversion: 2.1 time: 0.172653 Jul 15 15:44:07.533554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 548/1090] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:44:07 2022] GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:44:07.760021 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-77aebb67-55a3-47e6-9c8a-093285bde433 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:07.760675 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-77aebb67-55a3-47e6-9c8a-093285bde433 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:07.767582 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-77aebb67-55a3-47e6-9c8a-093285bde433 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:07.768413 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-77aebb67-55a3-47e6-9c8a-093285bde433 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:07.769655 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-77aebb67-55a3-47e6-9c8a-093285bde433 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:07.770080 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-77aebb67-55a3-47e6-9c8a-093285bde433 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:07.802255 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-77aebb67-55a3-47e6-9c8a-093285bde433 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:07.802727 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-77aebb67-55a3-47e6-9c8a-093285bde433 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:07.803170 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.objects.instance [None req-77aebb67-55a3-47e6-9c8a-093285bde433 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lazy-loading 'fault' on Instance uuid 3c767fdb-5253-437d-8856-2c5a8934d8ca {{(pid=117999) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:44:07.806079 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:44:07.849560 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-77aebb67-55a3-47e6-9c8a-093285bde433 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e56871077745d18a51c2855a48cb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f10e8177434ab69a22f1270cd8d0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:44:07.857904 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-77aebb67-55a3-47e6-9c8a-093285bde433 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 200 len: 1349 microversion: 2.1 time: 0.102622 Jul 15 15:44:07.858472 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 543/1091] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:44:07 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 1349 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:44:08.541725 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a762d12c-7928-4170-9530-93906ddc6271 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:08.542338 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a762d12c-7928-4170-9530-93906ddc6271 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:08.549605 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a762d12c-7928-4170-9530-93906ddc6271 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:08.550139 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a762d12c-7928-4170-9530-93906ddc6271 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:08.551183 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a762d12c-7928-4170-9530-93906ddc6271 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:08.551615 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a762d12c-7928-4170-9530-93906ddc6271 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:08.748510 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a762d12c-7928-4170-9530-93906ddc6271 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:44:08.757134 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a762d12c-7928-4170-9530-93906ddc6271 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b" status: 200 len: 1683 microversion: 2.1 time: 0.219294 Jul 15 15:44:08.757716 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 549/1092] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:44:08 2022] GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b => generated 1683 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:44:08.876901 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-2bfb81cd-a0f7-41bc-804f-094f40f1a683 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:08.877501 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-2bfb81cd-a0f7-41bc-804f-094f40f1a683 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] [instance: 3c767fdb-5253-437d-8856-2c5a8934d8ca] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:08.884604 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2bfb81cd-a0f7-41bc-804f-094f40f1a683 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:08.885048 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2bfb81cd-a0f7-41bc-804f-094f40f1a683 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:08.885819 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2bfb81cd-a0f7-41bc-804f-094f40f1a683 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:08.886242 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2bfb81cd-a0f7-41bc-804f-094f40f1a683 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:08.900377 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.wsgi [None req-2bfb81cd-a0f7-41bc-804f-094f40f1a683 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] HTTP exception thrown: Instance 3c767fdb-5253-437d-8856-2c5a8934d8ca could not be found. Jul 15 15:44:08.902044 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-2bfb81cd-a0f7-41bc-804f-094f40f1a683 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Request method failure captured: Jul 15 15:44:08.902044 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: request: GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca HTTP/1.1 Jul 15 15:44:08.902044 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept: application/json Jul 15 15:44:08.902044 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept-Encoding: identity Jul 15 15:44:08.902044 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Connection: close Jul 15 15:44:08.902044 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Length: 0 Jul 15 15:44:08.902044 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Type: application/json Jul 15 15:44:08.902044 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Host: 10.222.0.40 Jul 15 15:44:08.902044 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Openstack-System-Scope: None Jul 15 15:44:08.902044 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: User-Agent: python-urllib3/1.26.9 Jul 15 15:44:08.902044 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Auth-Token: gAAAAABi0YpKE0E1i4nj7JNw6pHftfCFmmLlACMfDv7r1aIL_PQ7sExCh2wisWhOSS-dAp2A8TuXHj1G9I1P3XzBVJNEaNwWIAo2zaC8Hihy3W4-he1-owmOJuVWFa00ePKI4llIvU9iRvvqySxwVhFAhYJu7g3EzwG3NILw_H6Iubm16P2-_Q4 Jul 15 15:44:08.902044 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Id: None Jul 15 15:44:08.902044 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Name: None Jul 15 15:44:08.902044 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Identity-Status: Confirmed Jul 15 15:44:08.902044 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Is-Admin-Project: True Jul 15 15:44:08.902044 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Id: default Jul 15 15:44:08.902044 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Name: Default Jul 15 15:44:08.902044 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Id: 25f10e8177434ab69a22f1270cd8d0db Jul 15 15:44:08.902044 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Name: tempest-TestMinimumBasicScenario-1750869290 Jul 15 15:44:08.902044 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Role: member,reader Jul 15 15:44:08.902044 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Roles: member,reader Jul 15 15:44:08.903811 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/25f10e8177434ab69a22f1270cd8d0db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_25f10e8177434ab69a22f1270cd8d0db", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/25f10e8177434ab69a22f1270cd8d0db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/25f10e8177434ab69a22f1270cd8d0db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:44:08.903811 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant: tempest-TestMinimumBasicScenario-1750869290 Jul 15 15:44:08.903811 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Id: 25f10e8177434ab69a22f1270cd8d0db Jul 15 15:44:08.903811 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1750869290 Jul 15 15:44:08.903811 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User: tempest-TestMinimumBasicScenario-1750869290-project Jul 15 15:44:08.903811 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Id: default Jul 15 15:44:08.903811 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Name: Default Jul 15 15:44:08.903811 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Id: 41e56871077745d18a51c2855a48cb7a Jul 15 15:44:08.903811 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Name: tempest-TestMinimumBasicScenario-1750869290-project Jul 15 15:44:08.903811 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: method: > Jul 15 15:44:08.903811 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: exception: Instance 3c767fdb-5253-437d-8856-2c5a8934d8ca could not be found. Jul 15 15:44:08.903811 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: action_args: {'id': '3c767fdb-5253-437d-8856-2c5a8934d8ca'} Jul 15 15:44:08.904823 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:44:08.904823 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:44:08.904823 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:44:08.904823 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:44:08.904823 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:44:08.904823 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:44:08.904823 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:44:08.904823 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:44:08.904823 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:44:08.904823 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:44:08.904823 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c767fdb-5253-437d-8856-2c5a8934d8ca could not be found. Jul 15 15:44:08.904823 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:44:08.904823 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:44:08.904823 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:44:08.904823 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:44:08.904823 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:44:08.904823 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:44:08.904823 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:44:08.904823 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:44:08.904823 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:44:08.906120 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:44:08.906120 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:44:08.906120 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:44:08.906120 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:44:08.906120 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:44:08.906120 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:44:08.906120 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:44:08.906120 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c767fdb-5253-437d-8856-2c5a8934d8ca could not be found. Jul 15 15:44:08.906120 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:44:08.906120 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:44:08.906120 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:44:08.906120 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:44:08.906120 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:44:08.906120 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:44:08.906120 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:44:08.906120 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:44:08.906120 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c767fdb-5253-437d-8856-2c5a8934d8ca could not be found. Jul 15 15:44:08.906120 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:44:08.907452 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-2bfb81cd-a0f7-41bc-804f-094f40f1a683 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Returning 404 to user: Instance 3c767fdb-5253-437d-8856-2c5a8934d8ca could not be found. {{(pid=117999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:44:08.907452 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-2bfb81cd-a0f7-41bc-804f-094f40f1a683 tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca" status: 404 len: 111 microversion: 2.1 time: 0.030474 Jul 15 15:44:08.907452 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 544/1093] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:44:08 2022] GET /compute/v2.1/servers/3c767fdb-5253-437d-8856-2c5a8934d8ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:44:08.913515 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f350e0d1-b11a-4cbe-9a99-debf68a7dc5d tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] Calling method '.version_select at 0x7fe3c6888160>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:08.932691 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f350e0d1-b11a-4cbe-9a99-debf68a7dc5d tempest-TestMinimumBasicScenario-1750869290 tempest-TestMinimumBasicScenario-1750869290-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1157789989" status: 202 len: 0 microversion: 2.1 time: 0.023480 Jul 15 15:44:08.933611 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 550/1094] 10.222.0.40 () {58 vars in 1271 bytes} [Fri Jul 15 15:44:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1157789989 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:44:09.102361 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-06a22ab1-1e8d-46ef-8509-ba44c949a7c1 req-0886d303-990b-46f4-a74d-d12def1851b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21725c3f-9223-4166-ab4e-58710b60743b", "name": "network-vif-deleted", "tag": "34f7ccc3-7013-46b4-b000-655458a36009"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:44:09.111648 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-06a22ab1-1e8d-46ef-8509-ba44c949a7c1 req-0886d303-990b-46f4-a74d-d12def1851b7 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:09.112349 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-06a22ab1-1e8d-46ef-8509-ba44c949a7c1 req-0886d303-990b-46f4-a74d-d12def1851b7 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:09.130445 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-06a22ab1-1e8d-46ef-8509-ba44c949a7c1 req-0886d303-990b-46f4-a74d-d12def1851b7 service nova] Creating event network-vif-deleted:34f7ccc3-7013-46b4-b000-655458a36009 for instance 21725c3f-9223-4166-ab4e-58710b60743b on hv-cinder-85001 Jul 15 15:44:09.136055 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-06a22ab1-1e8d-46ef-8509-ba44c949a7c1 req-0886d303-990b-46f4-a74d-d12def1851b7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037669 Jul 15 15:44:09.137212 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 545/1095] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:44:09.776577 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-fb29ff7e-a181-481b-a33e-2cdf494546fb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:09.777725 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-fb29ff7e-a181-481b-a33e-2cdf494546fb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:09.785458 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fb29ff7e-a181-481b-a33e-2cdf494546fb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:09.786443 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fb29ff7e-a181-481b-a33e-2cdf494546fb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:09.787580 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fb29ff7e-a181-481b-a33e-2cdf494546fb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:09.788118 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fb29ff7e-a181-481b-a33e-2cdf494546fb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:09.804599 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-fb29ff7e-a181-481b-a33e-2cdf494546fb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] HTTP exception thrown: Instance 21725c3f-9223-4166-ab4e-58710b60743b could not be found. Jul 15 15:44:09.806534 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-fb29ff7e-a181-481b-a33e-2cdf494546fb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Request method failure captured: Jul 15 15:44:09.806534 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b HTTP/1.1 Jul 15 15:44:09.806534 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:44:09.806534 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:44:09.806534 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:44:09.806534 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 15 15:44:09.806534 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:44:09.806534 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:44:09.806534 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:44:09.806534 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:44:09.806534 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0Yo0oWCcSgXmtT-AIlDmriNhuaROhcBGq6ue3L5Dg2A5mO8AU2ZxmGGSNs4xSg3UmnfAZL6PFQuplQb5tQv5obCaLScXfj5NCn3_QAidbr64Xyr4O6TBJXZrgWdTGNpso6LO-VMt9Fp0ms130e_ZCnxRJ6cb7aFMSAyXq4JV2-p6SZA Jul 15 15:44:09.806534 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:44:09.806534 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:44:09.806534 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:44:09.806534 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:44:09.806534 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:44:09.806534 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:44:09.806534 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: 46caece212e44751ba83b3dbfc8176ee Jul 15 15:44:09.806534 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:44:09.806534 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:44:09.806534 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:44:09.808318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_46caece212e44751ba83b3dbfc8176ee", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:44:09.808318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:44:09.808318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 46caece212e44751ba83b3dbfc8176ee Jul 15 15:44:09.808318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:44:09.808318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-AttachVolumeNegativeTest-461054684-project Jul 15 15:44:09.808318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:44:09.808318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:44:09.808318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: 862f9a645a6f4ffe8c0518504ed6d47c Jul 15 15:44:09.808318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-AttachVolumeNegativeTest-461054684-project Jul 15 15:44:09.808318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: > Jul 15 15:44:09.808318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Instance 21725c3f-9223-4166-ab4e-58710b60743b could not be found. Jul 15 15:44:09.808318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'id': '21725c3f-9223-4166-ab4e-58710b60743b'} Jul 15 15:44:09.809311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:44:09.809311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:44:09.809311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:44:09.809311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:44:09.809311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:44:09.809311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:44:09.809311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:44:09.809311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:44:09.809311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:44:09.809311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:44:09.809311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21725c3f-9223-4166-ab4e-58710b60743b could not be found. Jul 15 15:44:09.809311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:44:09.809311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:44:09.809311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:44:09.809311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:44:09.809311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:44:09.809311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:44:09.809311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:44:09.809311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:44:09.809311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:44:09.811669 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:44:09.811669 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:44:09.811669 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:44:09.811669 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:44:09.811669 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:44:09.811669 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:44:09.811669 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:44:09.811669 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21725c3f-9223-4166-ab4e-58710b60743b could not be found. Jul 15 15:44:09.811669 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:44:09.811669 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:44:09.811669 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:44:09.811669 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:44:09.811669 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:44:09.811669 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:44:09.811669 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:44:09.811669 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:44:09.811669 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21725c3f-9223-4166-ab4e-58710b60743b could not be found. Jul 15 15:44:09.811669 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:44:09.813082 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-fb29ff7e-a181-481b-a33e-2cdf494546fb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Returning 404 to user: Instance 21725c3f-9223-4166-ab4e-58710b60743b could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:44:09.813082 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-fb29ff7e-a181-481b-a33e-2cdf494546fb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b" status: 404 len: 111 microversion: 2.1 time: 0.038547 Jul 15 15:44:09.813082 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 551/1096] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:44:09 2022] GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:44:09.821121 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-b687f64a-d07a-4452-92e6-a1649cbf4c54 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '.version_select at 0x7fe3c6782310>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:09.842741 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-b687f64a-d07a-4452-92e6-a1649cbf4c54 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1844761330" status: 202 len: 0 microversion: 2.1 time: 0.026115 Jul 15 15:44:09.843758 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 546/1097] 10.222.0.40 () {58 vars in 1220 bytes} [Fri Jul 15 15:44:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1844761330 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:44:10.965704 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-bdff1d81-7517-408c-9cbb-daeaff2ea183 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Action: 'create', calling method: .version_select at 0x7fe3c670b700>, body: {"keypair": {"name": "tempest-keypair-1979597238", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbG35ot/09146/dWwV1NU+Y4nva0L/9+oru/8b9SYG9eihjOl/u3utoG42vc+8HJ9Zr9yyeG3pCkWcztnUMybhzXyclaxgqJCPj9L7NjJplP/dh0EqtRngMlxhAkeXUUg=="}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:44:10.982312 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-bdff1d81-7517-408c-9cbb-daeaff2ea183 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Getting quotas for project 46caece212e44751ba83b3dbfc8176ee. Resources: {'key_pairs'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:44:10.988031 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-bdff1d81-7517-408c-9cbb-daeaff2ea183 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Getting quotas for user 862f9a645a6f4ffe8c0518504ed6d47c and project 46caece212e44751ba83b3dbfc8176ee. Resources: {'key_pairs'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:44:11.015162 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-bdff1d81-7517-408c-9cbb-daeaff2ea183 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053350 Jul 15 15:44:11.015762 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 552/1098] 10.222.0.40 () {60 vars in 1158 bytes} [Fri Jul 15 15:44:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:44:12.810692 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-a6a78844-0725-4eed-831a-d04edd9879d9 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-40892549", "imageRef": "b9770891-ef3b-4f53-a989-3a4db420d5c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2849d693-fbe8-4fb0-bb77-6756df5e3eca"}], "security_groups": [{"name": "tempest-securitygroup--1334524985"}], "key_name": "tempest-keypair-1979597238", "user_data": "}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:44:12.978389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.network.neutron [None req-a6a78844-0725-4eed-831a-d04edd9879d9 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] validate_networks() for [('2849d693-fbe8-4fb0-bb77-6756df5e3eca', None, None, None, None, None)] {{(pid=117999) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:44:13.704407 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-a6a78844-0725-4eed-831a-d04edd9879d9 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Flavor limits 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:44:13.704851 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-a6a78844-0725-4eed-831a-d04edd9879d9 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Image limits 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:44:13.705337 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-a6a78844-0725-4eed-831a-d04edd9879d9 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Flavor pref 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:44:13.705735 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-a6a78844-0725-4eed-831a-d04edd9879d9 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Image pref 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:44:13.706124 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-a6a78844-0725-4eed-831a-d04edd9879d9 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:44:13.716234 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a6a78844-0725-4eed-831a-d04edd9879d9 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:13.716672 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a6a78844-0725-4eed-831a-d04edd9879d9 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:13.717448 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a6a78844-0725-4eed-831a-d04edd9879d9 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:13.717875 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a6a78844-0725-4eed-831a-d04edd9879d9 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:13.735825 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-a6a78844-0725-4eed-831a-d04edd9879d9 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Getting quotas for project 46caece212e44751ba83b3dbfc8176ee. Resources: {'ram', 'instances', 'cores'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:44:13.740121 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-a6a78844-0725-4eed-831a-d04edd9879d9 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Getting quotas for user 862f9a645a6f4ffe8c0518504ed6d47c and project 46caece212e44751ba83b3dbfc8176ee. Resources: {'ram', 'instances', 'cores'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:44:13.751652 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-a6a78844-0725-4eed-831a-d04edd9879d9 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Going to run 1 instances... {{(pid=117999) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:44:13.754094 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-a6a78844-0725-4eed-831a-d04edd9879d9 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9770891-ef3b-4f53-a989-3a4db420d5c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117999) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:44:13.805898 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-a6a78844-0725-4eed-831a-d04edd9879d9 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.001474 Jul 15 15:44:13.806565 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 547/1099] 10.222.0.40 () {60 vars in 1146 bytes} [Fri Jul 15 15:44:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 15:44:13.817828 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3ac3b1e5-d5e4-4ce5-ae86-480c8158e002 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:13.819094 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3ac3b1e5-d5e4-4ce5-ae86-480c8158e002 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:13.895485 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3ac3b1e5-d5e4-4ce5-ae86-480c8158e002 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:44:13.902714 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3ac3b1e5-d5e4-4ce5-ae86-480c8158e002 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5" status: 200 len: 1240 microversion: 2.1 time: 0.089313 Jul 15 15:44:13.903388 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 553/1100] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:44:13 2022] GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5 => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:44:14.922180 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-354a8ce1-2552-42e5-adb7-8d0744c49f42 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:14.923962 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-354a8ce1-2552-42e5-adb7-8d0744c49f42 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:15.000504 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-354a8ce1-2552-42e5-adb7-8d0744c49f42 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:44:15.009506 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-354a8ce1-2552-42e5-adb7-8d0744c49f42 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5" status: 200 len: 1240 microversion: 2.1 time: 0.093126 Jul 15 15:44:15.010557 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 548/1101] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:44:14 2022] GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5 => generated 1240 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:44:16.027110 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-812b33c1-8914-441f-bd40-e09a21d69497 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:16.029147 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-812b33c1-8914-441f-bd40-e09a21d69497 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:16.234564 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-812b33c1-8914-441f-bd40-e09a21d69497 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:44:16.242828 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-812b33c1-8914-441f-bd40-e09a21d69497 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5" status: 200 len: 1240 microversion: 2.1 time: 0.221153 Jul 15 15:44:16.245336 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 554/1102] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:44:16 2022] GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5 => generated 1240 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:44:17.261004 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-e369abef-9e34-4311-8457-d13e411cd996 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:17.261800 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-e369abef-9e34-4311-8457-d13e411cd996 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:17.269058 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e369abef-9e34-4311-8457-d13e411cd996 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:17.269588 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e369abef-9e34-4311-8457-d13e411cd996 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:17.270389 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e369abef-9e34-4311-8457-d13e411cd996 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:17.270810 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e369abef-9e34-4311-8457-d13e411cd996 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:17.337597 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e369abef-9e34-4311-8457-d13e411cd996 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:44:17.345150 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-e369abef-9e34-4311-8457-d13e411cd996 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5" status: 200 len: 1244 microversion: 2.1 time: 0.089092 Jul 15 15:44:17.345970 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 549/1103] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:44:17 2022] GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5 => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:44:18.362725 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8484b75e-192e-415d-ac0d-320159e0c434 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:18.364255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8484b75e-192e-415d-ac0d-320159e0c434 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:18.373649 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8484b75e-192e-415d-ac0d-320159e0c434 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:18.374175 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8484b75e-192e-415d-ac0d-320159e0c434 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:18.375337 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8484b75e-192e-415d-ac0d-320159e0c434 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:18.375817 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8484b75e-192e-415d-ac0d-320159e0c434 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:18.449592 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8484b75e-192e-415d-ac0d-320159e0c434 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:44:18.457772 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8484b75e-192e-415d-ac0d-320159e0c434 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5" status: 200 len: 1236 microversion: 2.1 time: 0.099386 Jul 15 15:44:18.468211 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 555/1104] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:44:18 2022] GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5 => generated 1236 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:44:19.475846 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-40098074-85af-4b19-9250-e9950e876bcb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:19.476518 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-40098074-85af-4b19-9250-e9950e876bcb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:19.483386 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-40098074-85af-4b19-9250-e9950e876bcb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:19.483805 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-40098074-85af-4b19-9250-e9950e876bcb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:19.484798 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-40098074-85af-4b19-9250-e9950e876bcb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:19.485266 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-40098074-85af-4b19-9250-e9950e876bcb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:19.567425 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-40098074-85af-4b19-9250-e9950e876bcb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:44:19.575358 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-40098074-85af-4b19-9250-e9950e876bcb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5" status: 200 len: 1298 microversion: 2.1 time: 0.103897 Jul 15 15:44:19.575938 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 550/1105] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:44:19 2022] GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5 => generated 1298 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:44:20.400099 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-624f7212-b5bf-40d8-82d8-73d392cb8046 req-7ba24abb-538a-4dea-a9af-8e72542bb094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da284fff-90a0-4533-b0ab-3946a528adb5", "tag": "d70610ce-5619-4959-abd3-5e257c4ab03a"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:44:20.423632 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-624f7212-b5bf-40d8-82d8-73d392cb8046 req-7ba24abb-538a-4dea-a9af-8e72542bb094 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:20.425555 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-624f7212-b5bf-40d8-82d8-73d392cb8046 req-7ba24abb-538a-4dea-a9af-8e72542bb094 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:20.440255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-624f7212-b5bf-40d8-82d8-73d392cb8046 req-7ba24abb-538a-4dea-a9af-8e72542bb094 service nova] Creating event network-changed:d70610ce-5619-4959-abd3-5e257c4ab03a for instance da284fff-90a0-4533-b0ab-3946a528adb5 on hv-cinder-85001 Jul 15 15:44:20.446628 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-624f7212-b5bf-40d8-82d8-73d392cb8046 req-7ba24abb-538a-4dea-a9af-8e72542bb094 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052792 Jul 15 15:44:20.447266 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 556/1106] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:44:20.593255 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-ab42388b-a9d0-4110-becf-88377cd679c2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:20.593868 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-ab42388b-a9d0-4110-becf-88377cd679c2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:20.600982 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ab42388b-a9d0-4110-becf-88377cd679c2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:20.601419 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ab42388b-a9d0-4110-becf-88377cd679c2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:20.602182 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ab42388b-a9d0-4110-becf-88377cd679c2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:20.602636 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ab42388b-a9d0-4110-becf-88377cd679c2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:20.877746 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-ab42388b-a9d0-4110-becf-88377cd679c2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:44:20.886840 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-ab42388b-a9d0-4110-becf-88377cd679c2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5" status: 200 len: 1366 microversion: 2.1 time: 0.297734 Jul 15 15:44:20.887472 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 551/1107] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:44:20 2022] GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5 => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:44:21.905939 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-58938934-2d31-4915-aab7-469572c048be tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:21.906605 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-58938934-2d31-4915-aab7-469572c048be tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:21.913744 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-58938934-2d31-4915-aab7-469572c048be tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:21.914182 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-58938934-2d31-4915-aab7-469572c048be tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:21.915005 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-58938934-2d31-4915-aab7-469572c048be tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:21.915411 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-58938934-2d31-4915-aab7-469572c048be tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:22.046033 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-58938934-2d31-4915-aab7-469572c048be tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:44:22.054430 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-58938934-2d31-4915-aab7-469572c048be tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5" status: 200 len: 1366 microversion: 2.1 time: 0.153193 Jul 15 15:44:22.055062 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 557/1108] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:44:21 2022] GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:44:23.071909 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-c062cc81-2e77-4516-a3c5-b170d1306752 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:23.072539 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-c062cc81-2e77-4516-a3c5-b170d1306752 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:23.079473 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c062cc81-2e77-4516-a3c5-b170d1306752 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:23.079918 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c062cc81-2e77-4516-a3c5-b170d1306752 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:23.080680 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c062cc81-2e77-4516-a3c5-b170d1306752 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:23.081116 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c062cc81-2e77-4516-a3c5-b170d1306752 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:23.218051 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-c062cc81-2e77-4516-a3c5-b170d1306752 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:44:23.226361 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-c062cc81-2e77-4516-a3c5-b170d1306752 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5" status: 200 len: 1366 microversion: 2.1 time: 0.158352 Jul 15 15:44:23.226962 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 552/1109] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:44:23 2022] GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:44:24.243971 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2b62cc88-c491-41fc-a1cc-01fdf61b4815 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:24.245354 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-2b62cc88-c491-41fc-a1cc-01fdf61b4815 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:24.251835 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2b62cc88-c491-41fc-a1cc-01fdf61b4815 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:24.252359 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2b62cc88-c491-41fc-a1cc-01fdf61b4815 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:24.253013 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2b62cc88-c491-41fc-a1cc-01fdf61b4815 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:24.253438 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2b62cc88-c491-41fc-a1cc-01fdf61b4815 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:24.387854 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2b62cc88-c491-41fc-a1cc-01fdf61b4815 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:44:24.396401 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-2b62cc88-c491-41fc-a1cc-01fdf61b4815 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5" status: 200 len: 1366 microversion: 2.1 time: 0.156713 Jul 15 15:44:24.396989 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 558/1110] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:44:24 2022] GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:44:25.413965 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-650885ff-821d-4bb1-9c55-8241026be1fe tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:25.414582 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-650885ff-821d-4bb1-9c55-8241026be1fe tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:25.416619 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=2 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:44:25.417816 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=8 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:44:25.418512 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:44:25.425366 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-650885ff-821d-4bb1-9c55-8241026be1fe tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:25.425847 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-650885ff-821d-4bb1-9c55-8241026be1fe tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:25.427096 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-650885ff-821d-4bb1-9c55-8241026be1fe tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:25.427791 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-650885ff-821d-4bb1-9c55-8241026be1fe tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:25.567995 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-650885ff-821d-4bb1-9c55-8241026be1fe tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:44:25.577885 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-650885ff-821d-4bb1-9c55-8241026be1fe tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5" status: 200 len: 1366 microversion: 2.1 time: 0.168253 Jul 15 15:44:25.578506 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 553/1111] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:44:25 2022] GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:44:26.180360 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-07ced45f-fe48-45e7-b414-9732a090a957 req-6975a48a-9877-4064-b16b-4ae4f3962371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da284fff-90a0-4533-b0ab-3946a528adb5", "name": "network-vif-plugged", "status": "completed", "tag": "d70610ce-5619-4959-abd3-5e257c4ab03a"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:44:26.184547 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:44:26.191070 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-07ced45f-fe48-45e7-b414-9732a090a957 req-6975a48a-9877-4064-b16b-4ae4f3962371 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:26.192028 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-07ced45f-fe48-45e7-b414-9732a090a957 req-6975a48a-9877-4064-b16b-4ae4f3962371 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:26.205969 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-07ced45f-fe48-45e7-b414-9732a090a957 req-6975a48a-9877-4064-b16b-4ae4f3962371 service nova] Creating event network-vif-plugged:d70610ce-5619-4959-abd3-5e257c4ab03a for instance da284fff-90a0-4533-b0ab-3946a528adb5 on hv-cinder-85001 Jul 15 15:44:26.212182 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-07ced45f-fe48-45e7-b414-9732a090a957 req-6975a48a-9877-4064-b16b-4ae4f3962371 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036333 Jul 15 15:44:26.213111 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 559/1112] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:44:26.597300 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-50e15ce8-76ee-4e4d-a339-482380ad310d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:26.597960 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-50e15ce8-76ee-4e4d-a339-482380ad310d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:26.605368 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-50e15ce8-76ee-4e4d-a339-482380ad310d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:26.605814 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-50e15ce8-76ee-4e4d-a339-482380ad310d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:26.606610 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-50e15ce8-76ee-4e4d-a339-482380ad310d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:26.607047 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-50e15ce8-76ee-4e4d-a339-482380ad310d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:26.740740 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-50e15ce8-76ee-4e4d-a339-482380ad310d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:44:26.748634 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-50e15ce8-76ee-4e4d-a339-482380ad310d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5" status: 200 len: 1366 microversion: 2.1 time: 0.155326 Jul 15 15:44:26.749209 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 554/1113] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:44:26 2022] GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:44:27.766766 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-bfe8077e-739a-45d2-bdf3-9c8710bc6816 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:27.767465 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-bfe8077e-739a-45d2-bdf3-9c8710bc6816 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:27.769753 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=8 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:44:27.777015 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bfe8077e-739a-45d2-bdf3-9c8710bc6816 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:27.777459 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bfe8077e-739a-45d2-bdf3-9c8710bc6816 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:27.778256 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bfe8077e-739a-45d2-bdf3-9c8710bc6816 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:27.778742 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bfe8077e-739a-45d2-bdf3-9c8710bc6816 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:27.925636 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-bfe8077e-739a-45d2-bdf3-9c8710bc6816 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:44:27.933557 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-bfe8077e-739a-45d2-bdf3-9c8710bc6816 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5" status: 200 len: 1366 microversion: 2.1 time: 0.171136 Jul 15 15:44:27.934122 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 560/1114] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:44:27 2022] GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:44:28.950923 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-77e22bac-b6c2-4ea7-88ff-4cc3202dfb06 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:28.952210 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-77e22bac-b6c2-4ea7-88ff-4cc3202dfb06 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:28.959682 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-77e22bac-b6c2-4ea7-88ff-4cc3202dfb06 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:28.960130 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-77e22bac-b6c2-4ea7-88ff-4cc3202dfb06 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:28.960891 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-77e22bac-b6c2-4ea7-88ff-4cc3202dfb06 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:28.961335 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-77e22bac-b6c2-4ea7-88ff-4cc3202dfb06 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:29.179952 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-77e22bac-b6c2-4ea7-88ff-4cc3202dfb06 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:44:29.188008 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-77e22bac-b6c2-4ea7-88ff-4cc3202dfb06 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5" status: 200 len: 1557 microversion: 2.1 time: 0.241037 Jul 15 15:44:29.188580 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 555/1115] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:44:28 2022] GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5 => generated 1557 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:44:29.205189 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-649a640c-2d63-450e-ac8c-a62da5214435 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:44:29.205807 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-649a640c-2d63-450e-ac8c-a62da5214435 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:44:29.212846 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-649a640c-2d63-450e-ac8c-a62da5214435 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:29.213289 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-649a640c-2d63-450e-ac8c-a62da5214435 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:29.214060 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-649a640c-2d63-450e-ac8c-a62da5214435 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:29.214483 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-649a640c-2d63-450e-ac8c-a62da5214435 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:29.299968 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-649a640c-2d63-450e-ac8c-a62da5214435 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098784 Jul 15 15:44:29.300684 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 561/1116] 10.222.0.40 () {58 vars in 1274 bytes} [Fri Jul 15 15:44:29 2022] GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:44:30.270362 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-45af4002-4f61-42ea-9ca8-56a22838fd82 req-325bbefd-4faa-4fbc-8055-c1652a493daf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da284fff-90a0-4533-b0ab-3946a528adb5", "tag": "d70610ce-5619-4959-abd3-5e257c4ab03a"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:44:30.280385 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-45af4002-4f61-42ea-9ca8-56a22838fd82 req-325bbefd-4faa-4fbc-8055-c1652a493daf service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:44:30.281103 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-45af4002-4f61-42ea-9ca8-56a22838fd82 req-325bbefd-4faa-4fbc-8055-c1652a493daf service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:44:30.293063 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-45af4002-4f61-42ea-9ca8-56a22838fd82 req-325bbefd-4faa-4fbc-8055-c1652a493daf service nova] Creating event network-changed:d70610ce-5619-4959-abd3-5e257c4ab03a for instance da284fff-90a0-4533-b0ab-3946a528adb5 on hv-cinder-85001 Jul 15 15:44:30.298124 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-45af4002-4f61-42ea-9ca8-56a22838fd82 req-325bbefd-4faa-4fbc-8055-c1652a493daf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031517 Jul 15 15:44:30.298717 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 556/1117] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:45:31.288345 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=5 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:45:31.289318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=40 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:45:31.294294 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=7 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:45:31.294832 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ee24eef5-8e1d-4e13-8eb1-a01dc9822116 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:31.294832 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ee24eef5-8e1d-4e13-8eb1-a01dc9822116 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 2973f7a5-3d6d-4aac-96d9-3a72c3be370a] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:45:31.295973 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=52 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:45:31.302900 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ee24eef5-8e1d-4e13-8eb1-a01dc9822116 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:31.303303 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ee24eef5-8e1d-4e13-8eb1-a01dc9822116 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:31.304064 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ee24eef5-8e1d-4e13-8eb1-a01dc9822116 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:31.304549 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ee24eef5-8e1d-4e13-8eb1-a01dc9822116 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:31.335635 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ee24eef5-8e1d-4e13-8eb1-a01dc9822116 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 2973f7a5-3d6d-4aac-96d9-3a72c3be370a] Going to try to terminate instance {{(pid=117998) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 15:45:31.433956 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ee24eef5-8e1d-4e13-8eb1-a01dc9822116 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a" status: 204 len: 0 microversion: 2.1 time: 0.147495 Jul 15 15:45:31.434737 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 562/1118] 10.222.0.40 () {58 vars in 1238 bytes} [Fri Jul 15 15:45:31 2022] DELETE /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:45:31.444755 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d3469ebb-a429-4239-b720-72657eea89ca tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:31.445485 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d3469ebb-a429-4239-b720-72657eea89ca tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 2973f7a5-3d6d-4aac-96d9-3a72c3be370a] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:45:31.452035 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d3469ebb-a429-4239-b720-72657eea89ca tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:31.452622 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d3469ebb-a429-4239-b720-72657eea89ca tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:31.453532 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d3469ebb-a429-4239-b720-72657eea89ca tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:31.454134 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d3469ebb-a429-4239-b720-72657eea89ca tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:31.501388 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-73f71f53-ff3a-47c9-bb1d-1de1c64e0b33 req-4c9c3618-d006-4934-9b8e-70b084d5dcb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2973f7a5-3d6d-4aac-96d9-3a72c3be370a", "tag": "4535b103-3842-4229-a1a3-7f29558cac2b"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:45:31.511808 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-73f71f53-ff3a-47c9-bb1d-1de1c64e0b33 req-4c9c3618-d006-4934-9b8e-70b084d5dcb2 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:31.512322 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-73f71f53-ff3a-47c9-bb1d-1de1c64e0b33 req-4c9c3618-d006-4934-9b8e-70b084d5dcb2 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:31.524993 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-73f71f53-ff3a-47c9-bb1d-1de1c64e0b33 req-4c9c3618-d006-4934-9b8e-70b084d5dcb2 service nova] Creating event network-changed:4535b103-3842-4229-a1a3-7f29558cac2b for instance 2973f7a5-3d6d-4aac-96d9-3a72c3be370a on hv-cinder-85001 Jul 15 15:45:31.531086 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-73f71f53-ff3a-47c9-bb1d-1de1c64e0b33 req-4c9c3618-d006-4934-9b8e-70b084d5dcb2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.239315 Jul 15 15:45:31.531768 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 557/1119] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:45:31.618304 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d3469ebb-a429-4239-b720-72657eea89ca tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:45:31.627214 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d3469ebb-a429-4239-b720-72657eea89ca tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a" status: 200 len: 1578 microversion: 2.1 time: 0.187268 Jul 15 15:45:31.628358 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 563/1120] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:45:31 2022] GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a => generated 1578 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 15:45:32.647168 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3abf30c7-c0bd-4c69-8925-f8302ca07f7a tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:32.647930 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-3abf30c7-c0bd-4c69-8925-f8302ca07f7a tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 2973f7a5-3d6d-4aac-96d9-3a72c3be370a] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:45:32.655205 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3abf30c7-c0bd-4c69-8925-f8302ca07f7a tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:32.655689 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3abf30c7-c0bd-4c69-8925-f8302ca07f7a tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:32.656555 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3abf30c7-c0bd-4c69-8925-f8302ca07f7a tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:32.657028 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3abf30c7-c0bd-4c69-8925-f8302ca07f7a tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:32.847985 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3abf30c7-c0bd-4c69-8925-f8302ca07f7a tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:45:32.857273 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-3abf30c7-c0bd-4c69-8925-f8302ca07f7a tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a" status: 200 len: 1578 microversion: 2.1 time: 0.215594 Jul 15 15:45:32.857939 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 558/1121] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:45:32 2022] GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a => generated 1578 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:45:33.877299 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b97d2dda-6121-422b-b087-7e4d567f3a96 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:33.878206 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b97d2dda-6121-422b-b087-7e4d567f3a96 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 2973f7a5-3d6d-4aac-96d9-3a72c3be370a] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:45:33.885493 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b97d2dda-6121-422b-b087-7e4d567f3a96 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:33.885938 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b97d2dda-6121-422b-b087-7e4d567f3a96 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:33.887391 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b97d2dda-6121-422b-b087-7e4d567f3a96 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:33.887391 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b97d2dda-6121-422b-b087-7e4d567f3a96 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:33.994691 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b97d2dda-6121-422b-b087-7e4d567f3a96 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:45:34.005911 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b97d2dda-6121-422b-b087-7e4d567f3a96 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a" status: 200 len: 1392 microversion: 2.1 time: 0.132778 Jul 15 15:45:34.006280 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-820f77a8-2202-4258-87e2-e0850cd5d324 req-f30e344a-ee73-4d6b-99b5-76dab63ce924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2973f7a5-3d6d-4aac-96d9-3a72c3be370a", "name": "network-vif-deleted", "tag": "4535b103-3842-4229-a1a3-7f29558cac2b"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:45:34.006804 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 564/1122] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:45:33 2022] GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a => generated 1392 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:45:34.015413 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-820f77a8-2202-4258-87e2-e0850cd5d324 req-f30e344a-ee73-4d6b-99b5-76dab63ce924 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:34.015834 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-820f77a8-2202-4258-87e2-e0850cd5d324 req-f30e344a-ee73-4d6b-99b5-76dab63ce924 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:34.029725 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-820f77a8-2202-4258-87e2-e0850cd5d324 req-f30e344a-ee73-4d6b-99b5-76dab63ce924 service nova] Creating event network-vif-deleted:4535b103-3842-4229-a1a3-7f29558cac2b for instance 2973f7a5-3d6d-4aac-96d9-3a72c3be370a on hv-cinder-85001 Jul 15 15:45:34.035483 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-820f77a8-2202-4258-87e2-e0850cd5d324 req-f30e344a-ee73-4d6b-99b5-76dab63ce924 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033874 Jul 15 15:45:34.036185 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 559/1123] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:45:35.027719 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2a1920b0-5882-45bd-a34d-2772d7046613 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:35.028484 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-2a1920b0-5882-45bd-a34d-2772d7046613 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 2973f7a5-3d6d-4aac-96d9-3a72c3be370a] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:45:35.036017 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2a1920b0-5882-45bd-a34d-2772d7046613 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:35.036444 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2a1920b0-5882-45bd-a34d-2772d7046613 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:35.037220 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2a1920b0-5882-45bd-a34d-2772d7046613 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:35.037639 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2a1920b0-5882-45bd-a34d-2772d7046613 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:35.051752 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-2a1920b0-5882-45bd-a34d-2772d7046613 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] HTTP exception thrown: Instance 2973f7a5-3d6d-4aac-96d9-3a72c3be370a could not be found. Jul 15 15:45:35.053456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2a1920b0-5882-45bd-a34d-2772d7046613 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Request method failure captured: Jul 15 15:45:35.053456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a HTTP/1.1 Jul 15 15:45:35.053456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:45:35.053456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:45:35.053456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:45:35.053456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 15 15:45:35.053456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:45:35.053456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:45:35.053456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:45:35.053456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:45:35.053456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0Yl3QyrwtcbE0Ohi9-IO2YJ45afwfKgzLdgCybs6siBE9y46qz8tzFFpUyiTeQzV2H47EEhDK8CRZfduO9MKkzGgbZsVNVLqhbxNZoCEver6kKU0wQPuI5NeZKHqIT9ErBTukewrBScSw5VC8j8qY6e0-deV-h4pvoVwhEU2BT8lNKA Jul 15 15:45:35.053456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:45:35.053456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:45:35.053456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:45:35.053456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:45:35.053456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:45:35.053456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:45:35.053456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: 9bda8b2837a54ec5a75c7dc355571255 Jul 15 15:45:35.053456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-TestVolumeBootPattern-809271764 Jul 15 15:45:35.053456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:45:35.053456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:45:35.055310 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9bda8b2837a54ec5a75c7dc355571255"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9bda8b2837a54ec5a75c7dc355571255", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9bda8b2837a54ec5a75c7dc355571255"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9bda8b2837a54ec5a75c7dc355571255"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:45:35.055310 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-TestVolumeBootPattern-809271764 Jul 15 15:45:35.055310 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 9bda8b2837a54ec5a75c7dc355571255 Jul 15 15:45:35.055310 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-TestVolumeBootPattern-809271764 Jul 15 15:45:35.055310 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-TestVolumeBootPattern-809271764-project Jul 15 15:45:35.055310 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:45:35.055310 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:45:35.055310 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: 4453bd7126a849f29cfe3d8bdf4531f1 Jul 15 15:45:35.055310 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-TestVolumeBootPattern-809271764-project Jul 15 15:45:35.055310 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: > Jul 15 15:45:35.055310 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Instance 2973f7a5-3d6d-4aac-96d9-3a72c3be370a could not be found. Jul 15 15:45:35.055310 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'id': '2973f7a5-3d6d-4aac-96d9-3a72c3be370a'} Jul 15 15:45:35.059574 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:45:35.059574 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:45:35.059574 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:45:35.059574 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:45:35.059574 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:45:35.059574 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:45:35.059574 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:45:35.059574 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:45:35.059574 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:45:35.059574 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:45:35.059574 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2973f7a5-3d6d-4aac-96d9-3a72c3be370a could not be found. Jul 15 15:45:35.059574 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:45:35.059574 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:45:35.059574 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:45:35.059574 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:45:35.059574 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:45:35.059574 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:45:35.059574 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:45:35.059574 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:45:35.059574 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:45:35.061191 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:45:35.061191 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:45:35.061191 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:45:35.061191 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:45:35.061191 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:45:35.061191 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:45:35.061191 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:45:35.061191 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2973f7a5-3d6d-4aac-96d9-3a72c3be370a could not be found. Jul 15 15:45:35.061191 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:45:35.061191 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:45:35.061191 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:45:35.061191 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:45:35.061191 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:45:35.061191 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:45:35.061191 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:45:35.061191 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:45:35.061191 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2973f7a5-3d6d-4aac-96d9-3a72c3be370a could not be found. Jul 15 15:45:35.061191 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:45:35.062631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2a1920b0-5882-45bd-a34d-2772d7046613 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Returning 404 to user: Instance 2973f7a5-3d6d-4aac-96d9-3a72c3be370a could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:45:35.062631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-2a1920b0-5882-45bd-a34d-2772d7046613 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a" status: 404 len: 111 microversion: 2.1 time: 0.031386 Jul 15 15:45:35.062631 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 565/1124] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:45:35 2022] GET /compute/v2.1/servers/2973f7a5-3d6d-4aac-96d9-3a72c3be370a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 15 15:45:38.206272 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-4d65cd6e-de89-4f23-bf26-e8cc2696c15f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:38.207106 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-4d65cd6e-de89-4f23-bf26-e8cc2696c15f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:45:38.209163 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-3410b284-1608-4101-9a0e-101778ec8311 req-ce61d84d-10b6-47fd-8980-e615af23b385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08079fe4-3136-4553-8307-59ab98073537", "tag": "f0be2353-05ff-4620-a1d0-be86ef2a4174"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:45:38.213768 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4d65cd6e-de89-4f23-bf26-e8cc2696c15f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:38.214215 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4d65cd6e-de89-4f23-bf26-e8cc2696c15f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:38.215016 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4d65cd6e-de89-4f23-bf26-e8cc2696c15f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:38.215443 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-4d65cd6e-de89-4f23-bf26-e8cc2696c15f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:38.218428 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-3410b284-1608-4101-9a0e-101778ec8311 req-ce61d84d-10b6-47fd-8980-e615af23b385 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:38.218880 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-3410b284-1608-4101-9a0e-101778ec8311 req-ce61d84d-10b6-47fd-8980-e615af23b385 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:38.231019 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-3410b284-1608-4101-9a0e-101778ec8311 req-ce61d84d-10b6-47fd-8980-e615af23b385 service nova] Creating event network-changed:f0be2353-05ff-4620-a1d0-be86ef2a4174 for instance 08079fe4-3136-4553-8307-59ab98073537 on hv-cinder-85001 Jul 15 15:45:38.236990 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-3410b284-1608-4101-9a0e-101778ec8311 req-ce61d84d-10b6-47fd-8980-e615af23b385 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032179 Jul 15 15:45:38.236990 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 566/1125] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:45:38.244002 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-4d65cd6e-de89-4f23-bf26-e8cc2696c15f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Going to try to terminate instance {{(pid=117999) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 15:45:38.329159 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-4d65cd6e-de89-4f23-bf26-e8cc2696c15f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "DELETE /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 204 len: 0 microversion: 2.1 time: 0.127339 Jul 15 15:45:38.334258 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 560/1126] 10.222.0.40 () {58 vars in 1238 bytes} [Fri Jul 15 15:45:38 2022] DELETE /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:45:38.343539 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-783a717d-d401-4dba-87a0-6b06ad0f0d53 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:38.344231 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-783a717d-d401-4dba-87a0-6b06ad0f0d53 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:45:38.351855 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-783a717d-d401-4dba-87a0-6b06ad0f0d53 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:38.352392 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-783a717d-d401-4dba-87a0-6b06ad0f0d53 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:38.353216 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-783a717d-d401-4dba-87a0-6b06ad0f0d53 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:38.353858 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-783a717d-d401-4dba-87a0-6b06ad0f0d53 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:38.555589 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-783a717d-d401-4dba-87a0-6b06ad0f0d53 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:45:38.564405 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-783a717d-d401-4dba-87a0-6b06ad0f0d53 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1577 microversion: 2.1 time: 0.227623 Jul 15 15:45:38.568944 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 567/1127] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:45:38 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1577 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:45:39.585036 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-37986108-d8a7-440c-bc92-e8cbea8ab815 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:39.585843 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-37986108-d8a7-440c-bc92-e8cbea8ab815 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:45:39.593450 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-37986108-d8a7-440c-bc92-e8cbea8ab815 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:39.593905 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-37986108-d8a7-440c-bc92-e8cbea8ab815 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:39.594885 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-37986108-d8a7-440c-bc92-e8cbea8ab815 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:39.595360 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-37986108-d8a7-440c-bc92-e8cbea8ab815 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:39.663264 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-37986108-d8a7-440c-bc92-e8cbea8ab815 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4453bd7126a849f29cfe3d8bdf4531f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bda8b2837a54ec5a75c7dc355571255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:45:39.671107 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-37986108-d8a7-440c-bc92-e8cbea8ab815 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 200 len: 1226 microversion: 2.1 time: 0.091448 Jul 15 15:45:39.671644 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 561/1128] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:45:39 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:45:40.257479 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-2afa5cf7-ed7d-49a3-acca-30cad23d89c1 req-05ddb470-0f05-4be7-8490-f25e7922020f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08079fe4-3136-4553-8307-59ab98073537", "name": "network-vif-deleted", "tag": "f0be2353-05ff-4620-a1d0-be86ef2a4174"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:45:40.268127 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-2afa5cf7-ed7d-49a3-acca-30cad23d89c1 req-05ddb470-0f05-4be7-8490-f25e7922020f service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:40.269447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-2afa5cf7-ed7d-49a3-acca-30cad23d89c1 req-05ddb470-0f05-4be7-8490-f25e7922020f service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:40.285968 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-2afa5cf7-ed7d-49a3-acca-30cad23d89c1 req-05ddb470-0f05-4be7-8490-f25e7922020f service nova] Creating event network-vif-deleted:f0be2353-05ff-4620-a1d0-be86ef2a4174 for instance 08079fe4-3136-4553-8307-59ab98073537 on hv-cinder-85001 Jul 15 15:45:40.292058 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-2afa5cf7-ed7d-49a3-acca-30cad23d89c1 req-05ddb470-0f05-4be7-8490-f25e7922020f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041502 Jul 15 15:45:40.292917 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 568/1129] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:45:40.688697 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-20228461-9fcc-4f20-8423-5cd5b4035f77 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:40.689308 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-20228461-9fcc-4f20-8423-5cd5b4035f77 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: 08079fe4-3136-4553-8307-59ab98073537] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:45:40.696223 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-20228461-9fcc-4f20-8423-5cd5b4035f77 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:40.696659 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-20228461-9fcc-4f20-8423-5cd5b4035f77 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:40.697407 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-20228461-9fcc-4f20-8423-5cd5b4035f77 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:40.697826 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-20228461-9fcc-4f20-8423-5cd5b4035f77 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:40.713777 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.wsgi [None req-20228461-9fcc-4f20-8423-5cd5b4035f77 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] HTTP exception thrown: Instance 08079fe4-3136-4553-8307-59ab98073537 could not be found. Jul 15 15:45:40.715418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-20228461-9fcc-4f20-8423-5cd5b4035f77 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Request method failure captured: Jul 15 15:45:40.715418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: request: GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 HTTP/1.1 Jul 15 15:45:40.715418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept: application/json Jul 15 15:45:40.715418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept-Encoding: identity Jul 15 15:45:40.715418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Connection: close Jul 15 15:45:40.715418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Length: 0 Jul 15 15:45:40.715418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Type: application/json Jul 15 15:45:40.715418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Host: 10.222.0.40 Jul 15 15:45:40.715418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Openstack-System-Scope: None Jul 15 15:45:40.715418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: User-Agent: python-urllib3/1.26.9 Jul 15 15:45:40.715418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Auth-Token: gAAAAABi0Yl3QyrwtcbE0Ohi9-IO2YJ45afwfKgzLdgCybs6siBE9y46qz8tzFFpUyiTeQzV2H47EEhDK8CRZfduO9MKkzGgbZsVNVLqhbxNZoCEver6kKU0wQPuI5NeZKHqIT9ErBTukewrBScSw5VC8j8qY6e0-deV-h4pvoVwhEU2BT8lNKA Jul 15 15:45:40.715418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Id: None Jul 15 15:45:40.715418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Name: None Jul 15 15:45:40.715418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Identity-Status: Confirmed Jul 15 15:45:40.715418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Is-Admin-Project: True Jul 15 15:45:40.715418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Id: default Jul 15 15:45:40.715418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Name: Default Jul 15 15:45:40.715418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Id: 9bda8b2837a54ec5a75c7dc355571255 Jul 15 15:45:40.715418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Name: tempest-TestVolumeBootPattern-809271764 Jul 15 15:45:40.715418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Role: member,reader Jul 15 15:45:40.715418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Roles: member,reader Jul 15 15:45:40.717114 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9bda8b2837a54ec5a75c7dc355571255"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9bda8b2837a54ec5a75c7dc355571255", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9bda8b2837a54ec5a75c7dc355571255"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9bda8b2837a54ec5a75c7dc355571255"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:45:40.717114 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant: tempest-TestVolumeBootPattern-809271764 Jul 15 15:45:40.717114 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Id: 9bda8b2837a54ec5a75c7dc355571255 Jul 15 15:45:40.717114 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Name: tempest-TestVolumeBootPattern-809271764 Jul 15 15:45:40.717114 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User: tempest-TestVolumeBootPattern-809271764-project Jul 15 15:45:40.717114 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Id: default Jul 15 15:45:40.717114 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Name: Default Jul 15 15:45:40.717114 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Id: 4453bd7126a849f29cfe3d8bdf4531f1 Jul 15 15:45:40.717114 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Name: tempest-TestVolumeBootPattern-809271764-project Jul 15 15:45:40.717114 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: method: > Jul 15 15:45:40.717114 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: exception: Instance 08079fe4-3136-4553-8307-59ab98073537 could not be found. Jul 15 15:45:40.717114 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: action_args: {'id': '08079fe4-3136-4553-8307-59ab98073537'} Jul 15 15:45:40.718401 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:45:40.718401 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:45:40.718401 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:45:40.718401 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:45:40.718401 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:45:40.718401 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:45:40.718401 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:45:40.718401 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:45:40.718401 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:45:40.718401 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:45:40.718401 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08079fe4-3136-4553-8307-59ab98073537 could not be found. Jul 15 15:45:40.718401 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:45:40.718401 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:45:40.718401 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:45:40.718401 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:45:40.718401 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:45:40.718401 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:45:40.718401 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:45:40.718401 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:45:40.718401 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:45:40.719739 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:45:40.719739 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:45:40.719739 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:45:40.719739 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:45:40.719739 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:45:40.719739 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:45:40.719739 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:45:40.719739 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08079fe4-3136-4553-8307-59ab98073537 could not be found. Jul 15 15:45:40.719739 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:45:40.719739 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:45:40.719739 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:45:40.719739 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:45:40.719739 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:45:40.719739 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:45:40.719739 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:45:40.719739 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:45:40.719739 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08079fe4-3136-4553-8307-59ab98073537 could not be found. Jul 15 15:45:40.719739 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:45:40.721013 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-20228461-9fcc-4f20-8423-5cd5b4035f77 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Returning 404 to user: Instance 08079fe4-3136-4553-8307-59ab98073537 could not be found. {{(pid=117999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:45:40.721013 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-20228461-9fcc-4f20-8423-5cd5b4035f77 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537" status: 404 len: 111 microversion: 2.1 time: 0.032119 Jul 15 15:45:40.721013 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 562/1130] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:45:40 2022] GET /compute/v2.1/servers/08079fe4-3136-4553-8307-59ab98073537 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:45:41.213723 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-57f0b487-a4f8-4b24-a704-5715c16de46f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:41.214600 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-57f0b487-a4f8-4b24-a704-5715c16de46f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:45:41.223981 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-57f0b487-a4f8-4b24-a704-5715c16de46f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:41.224455 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-57f0b487-a4f8-4b24-a704-5715c16de46f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:41.225244 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-57f0b487-a4f8-4b24-a704-5715c16de46f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:41.225693 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-57f0b487-a4f8-4b24-a704-5715c16de46f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:41.240607 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-57f0b487-a4f8-4b24-a704-5715c16de46f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] HTTP exception thrown: Instance e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec could not be found. Jul 15 15:45:41.242274 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-57f0b487-a4f8-4b24-a704-5715c16de46f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Request method failure captured: Jul 15 15:45:41.242274 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: DELETE /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec HTTP/1.1 Jul 15 15:45:41.242274 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:45:41.242274 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:45:41.242274 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:45:41.242274 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 15 15:45:41.242274 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:45:41.242274 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:45:41.242274 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:45:41.242274 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:45:41.242274 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0Yl3QyrwtcbE0Ohi9-IO2YJ45afwfKgzLdgCybs6siBE9y46qz8tzFFpUyiTeQzV2H47EEhDK8CRZfduO9MKkzGgbZsVNVLqhbxNZoCEver6kKU0wQPuI5NeZKHqIT9ErBTukewrBScSw5VC8j8qY6e0-deV-h4pvoVwhEU2BT8lNKA Jul 15 15:45:41.242274 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:45:41.242274 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:45:41.242274 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:45:41.242274 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:45:41.242274 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:45:41.242274 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:45:41.242274 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: 9bda8b2837a54ec5a75c7dc355571255 Jul 15 15:45:41.242274 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-TestVolumeBootPattern-809271764 Jul 15 15:45:41.242274 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:45:41.242274 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:45:41.244158 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9bda8b2837a54ec5a75c7dc355571255"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9bda8b2837a54ec5a75c7dc355571255", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9bda8b2837a54ec5a75c7dc355571255"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9bda8b2837a54ec5a75c7dc355571255"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:45:41.244158 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-TestVolumeBootPattern-809271764 Jul 15 15:45:41.244158 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 9bda8b2837a54ec5a75c7dc355571255 Jul 15 15:45:41.244158 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-TestVolumeBootPattern-809271764 Jul 15 15:45:41.244158 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-TestVolumeBootPattern-809271764-project Jul 15 15:45:41.244158 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:45:41.244158 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:45:41.244158 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: 4453bd7126a849f29cfe3d8bdf4531f1 Jul 15 15:45:41.244158 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-TestVolumeBootPattern-809271764-project Jul 15 15:45:41.244158 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: > Jul 15 15:45:41.244158 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Instance e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec could not be found. Jul 15 15:45:41.244158 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'id': 'e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec'} Jul 15 15:45:41.245021 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:45:41.245021 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:45:41.245021 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:45:41.245021 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:45:41.245021 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:45:41.245021 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:45:41.245021 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:45:41.245021 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:45:41.245021 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:45:41.245021 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:45:41.245021 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec could not be found. Jul 15 15:45:41.245021 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:45:41.245021 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:45:41.245021 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:45:41.245021 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:45:41.245021 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:45:41.245021 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:45:41.245021 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:45:41.245021 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:45:41.245021 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:45:41.246557 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:45:41.246557 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 15:45:41.246557 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 15:45:41.246557 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 15:45:41.246557 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 15:45:41.246557 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:45:41.246557 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:45:41.246557 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:45:41.246557 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:45:41.246557 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec could not be found. Jul 15 15:45:41.246557 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:45:41.246557 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:45:41.246557 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:45:41.246557 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:45:41.246557 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:45:41.246557 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:45:41.246557 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:45:41.246557 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:45:41.246557 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec could not be found. Jul 15 15:45:41.246557 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:45:41.249820 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-57f0b487-a4f8-4b24-a704-5715c16de46f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Returning 404 to user: Instance e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:45:41.249820 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-57f0b487-a4f8-4b24-a704-5715c16de46f tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec" status: 404 len: 111 microversion: 2.1 time: 0.037083 Jul 15 15:45:41.249820 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 569/1131] 10.222.0.40 () {58 vars in 1238 bytes} [Fri Jul 15 15:45:41 2022] DELETE /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:45:41.254902 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-64195a90-a1d1-4ac2-84e6-0fd84be7283e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:41.255522 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-64195a90-a1d1-4ac2-84e6-0fd84be7283e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] [instance: e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:45:41.261852 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-64195a90-a1d1-4ac2-84e6-0fd84be7283e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:41.262292 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-64195a90-a1d1-4ac2-84e6-0fd84be7283e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:41.263079 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-64195a90-a1d1-4ac2-84e6-0fd84be7283e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:41.263499 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-64195a90-a1d1-4ac2-84e6-0fd84be7283e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:41.277949 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.wsgi [None req-64195a90-a1d1-4ac2-84e6-0fd84be7283e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] HTTP exception thrown: Instance e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec could not be found. Jul 15 15:45:41.279264 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-64195a90-a1d1-4ac2-84e6-0fd84be7283e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Request method failure captured: Jul 15 15:45:41.279264 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: request: GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec HTTP/1.1 Jul 15 15:45:41.279264 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept: application/json Jul 15 15:45:41.279264 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept-Encoding: identity Jul 15 15:45:41.279264 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Connection: close Jul 15 15:45:41.279264 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Length: 0 Jul 15 15:45:41.279264 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Type: application/json Jul 15 15:45:41.279264 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Host: 10.222.0.40 Jul 15 15:45:41.279264 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Openstack-System-Scope: None Jul 15 15:45:41.279264 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: User-Agent: python-urllib3/1.26.9 Jul 15 15:45:41.279264 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Auth-Token: gAAAAABi0Yl3QyrwtcbE0Ohi9-IO2YJ45afwfKgzLdgCybs6siBE9y46qz8tzFFpUyiTeQzV2H47EEhDK8CRZfduO9MKkzGgbZsVNVLqhbxNZoCEver6kKU0wQPuI5NeZKHqIT9ErBTukewrBScSw5VC8j8qY6e0-deV-h4pvoVwhEU2BT8lNKA Jul 15 15:45:41.279264 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Id: None Jul 15 15:45:41.279264 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Name: None Jul 15 15:45:41.279264 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Identity-Status: Confirmed Jul 15 15:45:41.279264 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Is-Admin-Project: True Jul 15 15:45:41.279264 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Id: default Jul 15 15:45:41.279264 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Name: Default Jul 15 15:45:41.279264 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Id: 9bda8b2837a54ec5a75c7dc355571255 Jul 15 15:45:41.279264 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Name: tempest-TestVolumeBootPattern-809271764 Jul 15 15:45:41.279264 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Role: member,reader Jul 15 15:45:41.279264 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Roles: member,reader Jul 15 15:45:41.282025 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9bda8b2837a54ec5a75c7dc355571255"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9bda8b2837a54ec5a75c7dc355571255", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9bda8b2837a54ec5a75c7dc355571255"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9bda8b2837a54ec5a75c7dc355571255"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:45:41.282025 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant: tempest-TestVolumeBootPattern-809271764 Jul 15 15:45:41.282025 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Id: 9bda8b2837a54ec5a75c7dc355571255 Jul 15 15:45:41.282025 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Name: tempest-TestVolumeBootPattern-809271764 Jul 15 15:45:41.282025 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User: tempest-TestVolumeBootPattern-809271764-project Jul 15 15:45:41.282025 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Id: default Jul 15 15:45:41.282025 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Name: Default Jul 15 15:45:41.282025 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Id: 4453bd7126a849f29cfe3d8bdf4531f1 Jul 15 15:45:41.282025 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Name: tempest-TestVolumeBootPattern-809271764-project Jul 15 15:45:41.282025 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: method: > Jul 15 15:45:41.282025 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: exception: Instance e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec could not be found. Jul 15 15:45:41.282025 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: action_args: {'id': 'e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec'} Jul 15 15:45:41.283499 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:45:41.283499 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:45:41.283499 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:45:41.283499 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:45:41.283499 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:45:41.283499 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:45:41.283499 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:45:41.283499 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:45:41.283499 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:45:41.283499 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:45:41.283499 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec could not be found. Jul 15 15:45:41.283499 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:45:41.283499 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:45:41.283499 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:45:41.283499 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:45:41.283499 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:45:41.283499 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:45:41.283499 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:45:41.283499 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:45:41.283499 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:45:41.285793 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:45:41.285793 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:45:41.285793 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:45:41.285793 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:45:41.285793 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:45:41.285793 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:45:41.285793 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:45:41.285793 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec could not be found. Jul 15 15:45:41.285793 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:45:41.285793 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:45:41.285793 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:45:41.285793 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:45:41.285793 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:45:41.285793 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:45:41.285793 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:45:41.285793 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:45:41.285793 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec could not be found. Jul 15 15:45:41.285793 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:45:41.287301 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-64195a90-a1d1-4ac2-84e6-0fd84be7283e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Returning 404 to user: Instance e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec could not be found. {{(pid=117999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:45:41.287301 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-64195a90-a1d1-4ac2-84e6-0fd84be7283e tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec" status: 404 len: 111 microversion: 2.1 time: 0.029935 Jul 15 15:45:41.287301 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 563/1132] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:45:41 2022] GET /compute/v2.1/servers/e78f3433-9a9d-4e1f-84b6-f6ffd16b0dec => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:45:42.613752 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-81689c25-e2f3-413e-9719-1f42f0a7b087 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] Calling method '.version_select at 0x7fe3c68b5280>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:42.635523 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-81689c25-e2f3-413e-9719-1f42f0a7b087 tempest-TestVolumeBootPattern-809271764 tempest-TestVolumeBootPattern-809271764-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1986937243" status: 202 len: 0 microversion: 2.1 time: 0.026436 Jul 15 15:45:42.636315 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 570/1133] 10.222.0.40 () {58 vars in 1262 bytes} [Fri Jul 15 15:45:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1986937243 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:45:46.010931 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-56811463-a469-417e-8c77-eca241957074 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:46.012217 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-56811463-a469-417e-8c77-eca241957074 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:45:46.019360 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-56811463-a469-417e-8c77-eca241957074 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:46.020339 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-56811463-a469-417e-8c77-eca241957074 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:46.021359 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-56811463-a469-417e-8c77-eca241957074 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:46.021889 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-56811463-a469-417e-8c77-eca241957074 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:46.049072 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-56811463-a469-417e-8c77-eca241957074 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5/ips" status: 200 len: 151 microversion: 2.1 time: 0.174304 Jul 15 15:45:46.050064 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 564/1134] 10.222.0.40 () {58 vars in 1247 bytes} [Fri Jul 15 15:45:45 2022] GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5/ips => generated 151 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:45:47.475649 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6cc31405-f208-44a2-8c71-fc12309248fb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "316f7444-e25b-4daf-b78a-ddc17577c83b"}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:45:47.477480 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6cc31405-f208-44a2-8c71-fc12309248fb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:45:47.489743 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6cc31405-f208-44a2-8c71-fc12309248fb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:47.490831 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6cc31405-f208-44a2-8c71-fc12309248fb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:47.492126 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6cc31405-f208-44a2-8c71-fc12309248fb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:47.492840 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6cc31405-f208-44a2-8c71-fc12309248fb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:47.773642 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6cc31405-f208-44a2-8c71-fc12309248fb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "POST /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306246 Jul 15 15:45:47.774167 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 571/1135] 10.222.0.40 () {60 vars in 1322 bytes} [Fri Jul 15 15:45:47 2022] POST /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:45:55.340475 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-0ab61a3a-ad04-4e26-b2ae-eef95b138845 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "316f7444-e25b-4daf-b78a-ddc17577c83b"}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:45:55.341986 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-0ab61a3a-ad04-4e26-b2ae-eef95b138845 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:45:55.350490 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0ab61a3a-ad04-4e26-b2ae-eef95b138845 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:55.351032 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0ab61a3a-ad04-4e26-b2ae-eef95b138845 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:55.351798 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0ab61a3a-ad04-4e26-b2ae-eef95b138845 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:55.352214 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-0ab61a3a-ad04-4e26-b2ae-eef95b138845 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:55.447354 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.wsgi [None req-0ab61a3a-ad04-4e26-b2ae-eef95b138845 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] HTTP exception thrown: Invalid volume: volume 316f7444-e25b-4daf-b78a-ddc17577c83b is already attached to instances: da284fff-90a0-4533-b0ab-3946a528adb5 Jul 15 15:45:55.448978 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-0ab61a3a-ad04-4e26-b2ae-eef95b138845 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Request method failure captured: Jul 15 15:45:55.448978 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: request: POST /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5/os-volume_attachments HTTP/1.1 Jul 15 15:45:55.448978 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept: application/json Jul 15 15:45:55.448978 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept-Encoding: identity Jul 15 15:45:55.448978 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Connection: close Jul 15 15:45:55.448978 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Length: 74 Jul 15 15:45:55.448978 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Type: application/json Jul 15 15:45:55.448978 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Host: 10.222.0.40 Jul 15 15:45:55.448978 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Openstack-System-Scope: None Jul 15 15:45:55.448978 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: User-Agent: python-urllib3/1.26.9 Jul 15 15:45:55.448978 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Auth-Token: gAAAAABi0Yo0oWCcSgXmtT-AIlDmriNhuaROhcBGq6ue3L5Dg2A5mO8AU2ZxmGGSNs4xSg3UmnfAZL6PFQuplQb5tQv5obCaLScXfj5NCn3_QAidbr64Xyr4O6TBJXZrgWdTGNpso6LO-VMt9Fp0ms130e_ZCnxRJ6cb7aFMSAyXq4JV2-p6SZA Jul 15 15:45:55.448978 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Id: None Jul 15 15:45:55.448978 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Name: None Jul 15 15:45:55.448978 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Identity-Status: Confirmed Jul 15 15:45:55.448978 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Is-Admin-Project: True Jul 15 15:45:55.448978 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Id: default Jul 15 15:45:55.448978 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Name: Default Jul 15 15:45:55.448978 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Id: 46caece212e44751ba83b3dbfc8176ee Jul 15 15:45:55.448978 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Name: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:45:55.448978 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Role: member,reader Jul 15 15:45:55.448978 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Roles: member,reader Jul 15 15:45:55.450720 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_46caece212e44751ba83b3dbfc8176ee", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:45:55.450720 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:45:55.450720 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Id: 46caece212e44751ba83b3dbfc8176ee Jul 15 15:45:55.450720 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:45:55.450720 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User: tempest-AttachVolumeNegativeTest-461054684-project Jul 15 15:45:55.450720 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Id: default Jul 15 15:45:55.450720 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Name: Default Jul 15 15:45:55.450720 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Id: 862f9a645a6f4ffe8c0518504ed6d47c Jul 15 15:45:55.450720 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Name: tempest-AttachVolumeNegativeTest-461054684-project Jul 15 15:45:55.450720 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Jul 15 15:45:55.450720 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {"volumeAttachment": {"volumeId": "316f7444-e25b-4daf-b78a-ddc17577c83b"}} Jul 15 15:45:55.450720 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: method: > Jul 15 15:45:55.451844 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: exception: Invalid volume: volume 316f7444-e25b-4daf-b78a-ddc17577c83b is already attached to instances: da284fff-90a0-4533-b0ab-3946a528adb5 Jul 15 15:45:55.451844 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: action_args: {'server_id': 'da284fff-90a0-4533-b0ab-3946a528adb5', 'body': {'volumeAttachment': {'volumeId': '316f7444-e25b-4daf-b78a-ddc17577c83b'}}} Jul 15 15:45:55.451844 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:45:55.451844 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:45:55.451844 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 15 15:45:55.451844 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 15 15:45:55.451844 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 15 15:45:55.451844 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 15 15:45:55.451844 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 15 15:45:55.451844 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 15 15:45:55.451844 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 15 15:45:55.451844 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 15 15:45:55.451844 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 15 15:45:55.451844 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 15 15:45:55.451844 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 316f7444-e25b-4daf-b78a-ddc17577c83b is already attached to instances: da284fff-90a0-4533-b0ab-3946a528adb5 Jul 15 15:45:55.451844 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:45:55.451844 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:45:55.451844 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:45:55.451844 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:45:55.453187 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:45:55.453187 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:45:55.453187 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:45:55.453187 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:45:55.453187 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:45:55.453187 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:45:55.453187 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 15:45:55.453187 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 15:45:55.453187 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 15:45:55.453187 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 15:45:55.453187 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 15:45:55.453187 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 15:45:55.453187 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 15 15:45:55.453187 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 15 15:45:55.453187 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 316f7444-e25b-4daf-b78a-ddc17577c83b is already attached to instances: da284fff-90a0-4533-b0ab-3946a528adb5 Jul 15 15:45:55.453187 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:45:55.453187 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:45:55.453187 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:45:55.453187 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:45:55.453187 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:45:55.454506 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:45:55.454506 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:45:55.454506 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:45:55.454506 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 316f7444-e25b-4daf-b78a-ddc17577c83b is already attached to instances: da284fff-90a0-4533-b0ab-3946a528adb5 Jul 15 15:45:55.454506 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:45:55.454506 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-0ab61a3a-ad04-4e26-b2ae-eef95b138845 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Returning 400 to user: Invalid volume: volume 316f7444-e25b-4daf-b78a-ddc17577c83b is already attached to instances: da284fff-90a0-4533-b0ab-3946a528adb5 {{(pid=117999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:45:55.454506 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-0ab61a3a-ad04-4e26-b2ae-eef95b138845 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "POST /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.114716 Jul 15 15:45:55.454506 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 565/1136] 10.222.0.40 () {60 vars in 1322 bytes} [Fri Jul 15 15:45:55 2022] POST /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5/os-volume_attachments => generated 174 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 15 15:45:55.520253 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5aaf68a8-7dcb-460e-a466-83e151296053 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:55.520832 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5aaf68a8-7dcb-460e-a466-83e151296053 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:45:55.527646 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5aaf68a8-7dcb-460e-a466-83e151296053 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:55.528077 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5aaf68a8-7dcb-460e-a466-83e151296053 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:55.528910 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5aaf68a8-7dcb-460e-a466-83e151296053 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:55.529360 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5aaf68a8-7dcb-460e-a466-83e151296053 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:55.621163 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.objects.instance [None req-5aaf68a8-7dcb-460e-a466-83e151296053 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lazy-loading 'services' on Instance uuid da284fff-90a0-4533-b0ab-3946a528adb5 {{(pid=117998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:45:55.700554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5aaf68a8-7dcb-460e-a466-83e151296053 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "DELETE /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5/os-volume_attachments/316f7444-e25b-4daf-b78a-ddc17577c83b" status: 202 len: 0 microversion: 2.1 time: 0.185131 Jul 15 15:45:55.701282 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 572/1137] 10.222.0.40 () {58 vars in 1415 bytes} [Fri Jul 15 15:45:55 2022] DELETE /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5/os-volume_attachments/316f7444-e25b-4daf-b78a-ddc17577c83b => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:45:55.712034 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-ead8778c-59ed-4100-b40e-9a40825942c5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:55.713063 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-ead8778c-59ed-4100-b40e-9a40825942c5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:45:55.721856 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ead8778c-59ed-4100-b40e-9a40825942c5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:55.722327 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ead8778c-59ed-4100-b40e-9a40825942c5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:55.723144 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ead8778c-59ed-4100-b40e-9a40825942c5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:55.723569 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ead8778c-59ed-4100-b40e-9a40825942c5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:55.762855 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-ead8778c-59ed-4100-b40e-9a40825942c5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055547 Jul 15 15:45:55.763446 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 566/1138] 10.222.0.40 () {58 vars in 1301 bytes} [Fri Jul 15 15:45:55 2022] GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:45:56.777175 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-232ba69f-9378-4925-92ff-396bd464a244 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:56.778218 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-232ba69f-9378-4925-92ff-396bd464a244 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:45:56.785231 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-232ba69f-9378-4925-92ff-396bd464a244 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:56.785665 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-232ba69f-9378-4925-92ff-396bd464a244 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:56.786409 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-232ba69f-9378-4925-92ff-396bd464a244 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:56.786866 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-232ba69f-9378-4925-92ff-396bd464a244 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:56.817693 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-232ba69f-9378-4925-92ff-396bd464a244 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045502 Jul 15 15:45:56.818314 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 573/1139] 10.222.0.40 () {58 vars in 1301 bytes} [Fri Jul 15 15:45:56 2022] GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 15:45:56.886556 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-83acc033-586e-40a4-949b-547e0aa190e6 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:56.887244 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-83acc033-586e-40a4-949b-547e0aa190e6 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:45:56.897507 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-83acc033-586e-40a4-949b-547e0aa190e6 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:56.898181 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-83acc033-586e-40a4-949b-547e0aa190e6 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:56.899496 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-83acc033-586e-40a4-949b-547e0aa190e6 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:56.900169 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-83acc033-586e-40a4-949b-547e0aa190e6 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:56.939579 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-83acc033-586e-40a4-949b-547e0aa190e6 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] Going to try to terminate instance {{(pid=117999) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 15:45:57.031983 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-83acc033-586e-40a4-949b-547e0aa190e6 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "DELETE /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5" status: 204 len: 0 microversion: 2.1 time: 0.151455 Jul 15 15:45:57.032852 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 567/1140] 10.222.0.40 () {58 vars in 1238 bytes} [Fri Jul 15 15:45:56 2022] DELETE /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:45:57.042934 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0ce0ddaa-3258-4242-a3df-77dbcea12880 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:57.043546 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-0ce0ddaa-3258-4242-a3df-77dbcea12880 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:45:57.050724 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0ce0ddaa-3258-4242-a3df-77dbcea12880 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:57.051307 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0ce0ddaa-3258-4242-a3df-77dbcea12880 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:57.052105 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0ce0ddaa-3258-4242-a3df-77dbcea12880 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:57.052536 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0ce0ddaa-3258-4242-a3df-77dbcea12880 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:57.203255 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0ce0ddaa-3258-4242-a3df-77dbcea12880 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:45:57.213645 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-0ce0ddaa-3258-4242-a3df-77dbcea12880 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5" status: 200 len: 1682 microversion: 2.1 time: 0.174958 Jul 15 15:45:57.214464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 574/1141] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:45:57 2022] GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:45:58.236069 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-d0e8b1a3-0eaa-4a95-9352-b2b845db3253 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:58.236766 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-d0e8b1a3-0eaa-4a95-9352-b2b845db3253 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:45:58.244400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d0e8b1a3-0eaa-4a95-9352-b2b845db3253 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:58.244837 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d0e8b1a3-0eaa-4a95-9352-b2b845db3253 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:58.245594 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d0e8b1a3-0eaa-4a95-9352-b2b845db3253 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:58.246037 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d0e8b1a3-0eaa-4a95-9352-b2b845db3253 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:58.382827 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-d0e8b1a3-0eaa-4a95-9352-b2b845db3253 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:45:58.394393 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-d0e8b1a3-0eaa-4a95-9352-b2b845db3253 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5" status: 200 len: 1682 microversion: 2.1 time: 0.162510 Jul 15 15:45:58.395231 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 568/1142] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:45:58 2022] GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:45:59.416805 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6cb5d2b7-272b-45d4-82e0-7e17325cc7fc tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:45:59.417475 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6cb5d2b7-272b-45d4-82e0-7e17325cc7fc tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:45:59.424422 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6cb5d2b7-272b-45d4-82e0-7e17325cc7fc tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:59.424864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6cb5d2b7-272b-45d4-82e0-7e17325cc7fc tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:59.425685 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6cb5d2b7-272b-45d4-82e0-7e17325cc7fc tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:45:59.426115 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6cb5d2b7-272b-45d4-82e0-7e17325cc7fc tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:45:59.632098 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6cb5d2b7-272b-45d4-82e0-7e17325cc7fc tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:45:59.643811 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6cb5d2b7-272b-45d4-82e0-7e17325cc7fc tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5" status: 200 len: 1682 microversion: 2.1 time: 0.231106 Jul 15 15:45:59.644392 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 575/1143] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:45:59 2022] GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5 => generated 1682 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:46:00.048128 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-6f500871-a5c7-4e2d-9888-ea83a1a68c3b req-1c5a4245-ce19-4eba-91f7-abda73e4f1c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da284fff-90a0-4533-b0ab-3946a528adb5", "name": "network-vif-deleted", "tag": "d70610ce-5619-4959-abd3-5e257c4ab03a"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:46:00.061159 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-6f500871-a5c7-4e2d-9888-ea83a1a68c3b req-1c5a4245-ce19-4eba-91f7-abda73e4f1c8 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:00.062706 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-6f500871-a5c7-4e2d-9888-ea83a1a68c3b req-1c5a4245-ce19-4eba-91f7-abda73e4f1c8 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:00.076599 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-6f500871-a5c7-4e2d-9888-ea83a1a68c3b req-1c5a4245-ce19-4eba-91f7-abda73e4f1c8 service nova] Creating event network-vif-deleted:d70610ce-5619-4959-abd3-5e257c4ab03a for instance da284fff-90a0-4533-b0ab-3946a528adb5 on hv-cinder-85001 Jul 15 15:46:00.084548 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-6f500871-a5c7-4e2d-9888-ea83a1a68c3b req-1c5a4245-ce19-4eba-91f7-abda73e4f1c8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040944 Jul 15 15:46:00.085436 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 569/1144] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:46:00.662045 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a858a031-8daf-4abd-9b48-ddc54a64bc0d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:00.662692 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a858a031-8daf-4abd-9b48-ddc54a64bc0d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:46:00.669788 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a858a031-8daf-4abd-9b48-ddc54a64bc0d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:00.670225 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a858a031-8daf-4abd-9b48-ddc54a64bc0d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:00.671051 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a858a031-8daf-4abd-9b48-ddc54a64bc0d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:00.671471 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a858a031-8daf-4abd-9b48-ddc54a64bc0d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:00.689924 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-a858a031-8daf-4abd-9b48-ddc54a64bc0d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] HTTP exception thrown: Instance da284fff-90a0-4533-b0ab-3946a528adb5 could not be found. Jul 15 15:46:00.691940 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a858a031-8daf-4abd-9b48-ddc54a64bc0d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Request method failure captured: Jul 15 15:46:00.691940 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5 HTTP/1.1 Jul 15 15:46:00.691940 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:46:00.691940 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:46:00.691940 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:46:00.691940 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 15 15:46:00.691940 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:46:00.691940 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:46:00.691940 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:46:00.691940 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:46:00.691940 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0Yo0oWCcSgXmtT-AIlDmriNhuaROhcBGq6ue3L5Dg2A5mO8AU2ZxmGGSNs4xSg3UmnfAZL6PFQuplQb5tQv5obCaLScXfj5NCn3_QAidbr64Xyr4O6TBJXZrgWdTGNpso6LO-VMt9Fp0ms130e_ZCnxRJ6cb7aFMSAyXq4JV2-p6SZA Jul 15 15:46:00.691940 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:46:00.691940 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:46:00.691940 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:46:00.691940 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:46:00.691940 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:46:00.691940 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:46:00.691940 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: 46caece212e44751ba83b3dbfc8176ee Jul 15 15:46:00.691940 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:46:00.691940 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:46:00.691940 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:46:00.693564 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_46caece212e44751ba83b3dbfc8176ee", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:46:00.693564 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:46:00.693564 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 46caece212e44751ba83b3dbfc8176ee Jul 15 15:46:00.693564 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:46:00.693564 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-AttachVolumeNegativeTest-461054684-project Jul 15 15:46:00.693564 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:46:00.693564 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:46:00.693564 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: 862f9a645a6f4ffe8c0518504ed6d47c Jul 15 15:46:00.693564 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-AttachVolumeNegativeTest-461054684-project Jul 15 15:46:00.693564 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: > Jul 15 15:46:00.693564 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Instance da284fff-90a0-4533-b0ab-3946a528adb5 could not be found. Jul 15 15:46:00.693564 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'id': 'da284fff-90a0-4533-b0ab-3946a528adb5'} Jul 15 15:46:00.694558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:46:00.694558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:46:00.694558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:46:00.694558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:46:00.694558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:46:00.694558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:46:00.694558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:46:00.694558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:46:00.694558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:46:00.694558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:46:00.694558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da284fff-90a0-4533-b0ab-3946a528adb5 could not be found. Jul 15 15:46:00.694558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:46:00.694558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:46:00.694558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:46:00.694558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:46:00.694558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:46:00.694558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:46:00.694558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:46:00.694558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:46:00.694558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:46:00.696464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:46:00.696464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:46:00.696464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:46:00.696464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:46:00.696464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:46:00.696464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:46:00.696464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:46:00.696464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da284fff-90a0-4533-b0ab-3946a528adb5 could not be found. Jul 15 15:46:00.696464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:46:00.696464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:46:00.696464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:46:00.696464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:46:00.696464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:46:00.696464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:46:00.696464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:46:00.696464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:46:00.696464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da284fff-90a0-4533-b0ab-3946a528adb5 could not be found. Jul 15 15:46:00.696464 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:46:00.697689 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a858a031-8daf-4abd-9b48-ddc54a64bc0d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Returning 404 to user: Instance da284fff-90a0-4533-b0ab-3946a528adb5 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:46:00.697689 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a858a031-8daf-4abd-9b48-ddc54a64bc0d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5" status: 404 len: 111 microversion: 2.1 time: 0.035374 Jul 15 15:46:00.697689 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 576/1145] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:46:00 2022] GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:46:00.706223 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-33d4c4f6-62d5-4811-a0f5-47859206cca4 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '.version_select at 0x7fe3c6856b80>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:00.730001 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-33d4c4f6-62d5-4811-a0f5-47859206cca4 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1979597238" status: 202 len: 0 microversion: 2.1 time: 0.028721 Jul 15 15:46:00.735122 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 570/1146] 10.222.0.40 () {58 vars in 1220 bytes} [Fri Jul 15 15:46:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1979597238 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:46:01.444159 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0a9235be-606c-4eef-840b-ceb236e122e4 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Action: 'create', calling method: .version_select at 0x7fe3c686fc10>, body: {"keypair": {"name": "tempest-keypair-691950237", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlL25VDs5aTBvriDPnV7Do1Q2rDM+LUOZ8oGADC0EbvMpvEASdVXTj8RDcp54vyhcsbaJSb0c+lZUNlufyMy3O9n46zJCCyp/8NOTMayO4Bds/rOwQ1WhVCW5b9VDMmyA=="}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:46:01.449047 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:46:01.466816 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-0a9235be-606c-4eef-840b-ceb236e122e4 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Getting quotas for project 46caece212e44751ba83b3dbfc8176ee. Resources: {'key_pairs'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:46:01.472929 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-0a9235be-606c-4eef-840b-ceb236e122e4 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Getting quotas for user 862f9a645a6f4ffe8c0518504ed6d47c and project 46caece212e44751ba83b3dbfc8176ee. Resources: {'key_pairs'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:46:01.500315 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-0a9235be-606c-4eef-840b-ceb236e122e4 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060536 Jul 15 15:46:01.501005 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 577/1147] 10.222.0.40 () {60 vars in 1158 bytes} [Fri Jul 15 15:46:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:46:02.921933 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3f47d5c3-47ef-40ee-a5e6-01891559f1cb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1372104009", "imageRef": "b9770891-ef3b-4f53-a989-3a4db420d5c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2849d693-fbe8-4fb0-bb77-6756df5e3eca"}], "security_groups": [{"name": "tempest-securitygroup--340888911"}], "key_name": "tempest-keypair-691950237", "user_data": "}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:46:02.929297 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:46:03.053470 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.network.neutron [None req-3f47d5c3-47ef-40ee-a5e6-01891559f1cb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] validate_networks() for [('2849d693-fbe8-4fb0-bb77-6756df5e3eca', None, None, None, None, None)] {{(pid=117999) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:46:03.536169 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-3f47d5c3-47ef-40ee-a5e6-01891559f1cb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Flavor limits 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:46:03.536652 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-3f47d5c3-47ef-40ee-a5e6-01891559f1cb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Image limits 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:46:03.537192 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-3f47d5c3-47ef-40ee-a5e6-01891559f1cb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Flavor pref 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:46:03.537594 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-3f47d5c3-47ef-40ee-a5e6-01891559f1cb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Image pref 0:0:0 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:46:03.538024 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.virt.hardware [None req-3f47d5c3-47ef-40ee-a5e6-01891559f1cb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117999) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:46:03.547637 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3f47d5c3-47ef-40ee-a5e6-01891559f1cb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:03.548078 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3f47d5c3-47ef-40ee-a5e6-01891559f1cb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:03.548873 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3f47d5c3-47ef-40ee-a5e6-01891559f1cb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:03.549295 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3f47d5c3-47ef-40ee-a5e6-01891559f1cb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:03.554944 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:46:03.569063 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-3f47d5c3-47ef-40ee-a5e6-01891559f1cb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Getting quotas for project 46caece212e44751ba83b3dbfc8176ee. Resources: {'ram', 'instances', 'cores'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:46:03.573069 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-3f47d5c3-47ef-40ee-a5e6-01891559f1cb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Getting quotas for user 862f9a645a6f4ffe8c0518504ed6d47c and project 46caece212e44751ba83b3dbfc8176ee. Resources: {'ram', 'instances', 'cores'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:46:03.583900 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-3f47d5c3-47ef-40ee-a5e6-01891559f1cb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Going to run 1 instances... {{(pid=117999) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:46:03.586315 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-3f47d5c3-47ef-40ee-a5e6-01891559f1cb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 06fef22c-6025-483e-ad3b-7be9cf865575] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9770891-ef3b-4f53-a989-3a4db420d5c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117999) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:46:03.633270 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-3f47d5c3-47ef-40ee-a5e6-01891559f1cb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.715845 Jul 15 15:46:03.634415 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 571/1148] 10.222.0.40 () {60 vars in 1146 bytes} [Fri Jul 15 15:46:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 15:46:03.645022 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e2d1153a-7f7b-49e7-93e9-b90450bbd6bb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:03.645977 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e2d1153a-7f7b-49e7-93e9-b90450bbd6bb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 06fef22c-6025-483e-ad3b-7be9cf865575] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:46:03.708691 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e2d1153a-7f7b-49e7-93e9-b90450bbd6bb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:46:03.716543 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e2d1153a-7f7b-49e7-93e9-b90450bbd6bb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575" status: 200 len: 1241 microversion: 2.1 time: 0.075983 Jul 15 15:46:03.717128 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 578/1149] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:46:03 2022] GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575 => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:46:04.736275 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-97e525d7-4802-4157-a3d2-6f1ccc1330ef tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:04.736887 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-97e525d7-4802-4157-a3d2-6f1ccc1330ef tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 06fef22c-6025-483e-ad3b-7be9cf865575] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:46:04.746053 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-97e525d7-4802-4157-a3d2-6f1ccc1330ef tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:04.746530 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-97e525d7-4802-4157-a3d2-6f1ccc1330ef tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:04.747342 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-97e525d7-4802-4157-a3d2-6f1ccc1330ef tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:04.747767 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-97e525d7-4802-4157-a3d2-6f1ccc1330ef tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:04.857385 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-97e525d7-4802-4157-a3d2-6f1ccc1330ef tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:46:04.865735 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-97e525d7-4802-4157-a3d2-6f1ccc1330ef tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575" status: 200 len: 1299 microversion: 2.1 time: 0.134786 Jul 15 15:46:04.866930 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 572/1150] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:46:04 2022] GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575 => generated 1299 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:46:05.886750 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2cbe5769-b02d-4c71-9ede-e8d841028ae3 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:05.887402 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-2cbe5769-b02d-4c71-9ede-e8d841028ae3 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 06fef22c-6025-483e-ad3b-7be9cf865575] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:46:05.895048 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2cbe5769-b02d-4c71-9ede-e8d841028ae3 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:05.895460 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2cbe5769-b02d-4c71-9ede-e8d841028ae3 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:05.896473 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2cbe5769-b02d-4c71-9ede-e8d841028ae3 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:05.896869 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2cbe5769-b02d-4c71-9ede-e8d841028ae3 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:05.900379 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:46:06.093940 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2cbe5769-b02d-4c71-9ede-e8d841028ae3 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:46:06.102770 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-2cbe5769-b02d-4c71-9ede-e8d841028ae3 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575" status: 200 len: 1366 microversion: 2.1 time: 0.221210 Jul 15 15:46:06.104224 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 579/1151] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:46:05 2022] GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:46:06.219824 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-287d7789-2d7b-437d-8485-a4ba413b65bb req-1ab0cf7c-0fcb-4015-a0bc-01d483006aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06fef22c-6025-483e-ad3b-7be9cf865575", "tag": "b72b9f11-5a73-456f-b8c6-8e42b57e5195"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:46:06.235140 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-287d7789-2d7b-437d-8485-a4ba413b65bb req-1ab0cf7c-0fcb-4015-a0bc-01d483006aa3 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:06.235726 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-287d7789-2d7b-437d-8485-a4ba413b65bb req-1ab0cf7c-0fcb-4015-a0bc-01d483006aa3 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:06.260188 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-287d7789-2d7b-437d-8485-a4ba413b65bb req-1ab0cf7c-0fcb-4015-a0bc-01d483006aa3 service nova] Creating event network-changed:b72b9f11-5a73-456f-b8c6-8e42b57e5195 for instance 06fef22c-6025-483e-ad3b-7be9cf865575 on hv-cinder-85001 Jul 15 15:46:06.265732 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-287d7789-2d7b-437d-8485-a4ba413b65bb req-1ab0cf7c-0fcb-4015-a0bc-01d483006aa3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050373 Jul 15 15:46:06.267107 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 573/1152] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:46:07.122303 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5c2a60ea-5580-4867-86ce-64a1ff0bfc7f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:07.122967 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5c2a60ea-5580-4867-86ce-64a1ff0bfc7f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 06fef22c-6025-483e-ad3b-7be9cf865575] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:46:07.130184 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5c2a60ea-5580-4867-86ce-64a1ff0bfc7f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:07.130653 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5c2a60ea-5580-4867-86ce-64a1ff0bfc7f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:07.131422 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5c2a60ea-5580-4867-86ce-64a1ff0bfc7f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:07.131838 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5c2a60ea-5580-4867-86ce-64a1ff0bfc7f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:07.283054 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5c2a60ea-5580-4867-86ce-64a1ff0bfc7f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:46:07.290984 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5c2a60ea-5580-4867-86ce-64a1ff0bfc7f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575" status: 200 len: 1366 microversion: 2.1 time: 0.172694 Jul 15 15:46:07.291553 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 580/1153] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:46:07 2022] GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:46:08.309169 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-31dd9447-40b2-4cc2-8090-ec2a960bbe21 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:08.309864 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-31dd9447-40b2-4cc2-8090-ec2a960bbe21 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 06fef22c-6025-483e-ad3b-7be9cf865575] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:46:08.316699 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-31dd9447-40b2-4cc2-8090-ec2a960bbe21 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:08.317137 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-31dd9447-40b2-4cc2-8090-ec2a960bbe21 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:08.317906 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-31dd9447-40b2-4cc2-8090-ec2a960bbe21 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:08.318327 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-31dd9447-40b2-4cc2-8090-ec2a960bbe21 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:08.468783 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-31dd9447-40b2-4cc2-8090-ec2a960bbe21 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:46:08.476399 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-31dd9447-40b2-4cc2-8090-ec2a960bbe21 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575" status: 200 len: 1366 microversion: 2.1 time: 0.171754 Jul 15 15:46:08.476989 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 574/1154] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:46:08 2022] GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:46:09.496555 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e30e5a0c-ad31-403a-a945-78ce81af281f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:09.497224 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e30e5a0c-ad31-403a-a945-78ce81af281f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 06fef22c-6025-483e-ad3b-7be9cf865575] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:46:09.508076 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e30e5a0c-ad31-403a-a945-78ce81af281f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:09.508634 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e30e5a0c-ad31-403a-a945-78ce81af281f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:09.509909 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e30e5a0c-ad31-403a-a945-78ce81af281f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:09.510913 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e30e5a0c-ad31-403a-a945-78ce81af281f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:09.647497 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e30e5a0c-ad31-403a-a945-78ce81af281f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:46:09.655498 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e30e5a0c-ad31-403a-a945-78ce81af281f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575" status: 200 len: 1366 microversion: 2.1 time: 0.164958 Jul 15 15:46:09.656046 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 581/1155] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:46:09 2022] GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:46:10.675741 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-2277e6e1-8b33-466c-a558-19540ec6accb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:10.676364 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-2277e6e1-8b33-466c-a558-19540ec6accb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 06fef22c-6025-483e-ad3b-7be9cf865575] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:46:10.683433 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2277e6e1-8b33-466c-a558-19540ec6accb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:10.683850 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2277e6e1-8b33-466c-a558-19540ec6accb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:10.684732 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2277e6e1-8b33-466c-a558-19540ec6accb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:10.685157 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2277e6e1-8b33-466c-a558-19540ec6accb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:10.838146 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-2277e6e1-8b33-466c-a558-19540ec6accb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:46:10.847360 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-2277e6e1-8b33-466c-a558-19540ec6accb tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575" status: 200 len: 1366 microversion: 2.1 time: 0.175608 Jul 15 15:46:10.847954 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 575/1156] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:46:10 2022] GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:46:11.864717 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3e35d519-0150-4ab5-a9ff-de13c36e184a tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:11.865323 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3e35d519-0150-4ab5-a9ff-de13c36e184a tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 06fef22c-6025-483e-ad3b-7be9cf865575] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:46:11.872666 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3e35d519-0150-4ab5-a9ff-de13c36e184a tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:11.873104 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3e35d519-0150-4ab5-a9ff-de13c36e184a tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:11.873861 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3e35d519-0150-4ab5-a9ff-de13c36e184a tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:11.874285 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3e35d519-0150-4ab5-a9ff-de13c36e184a tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:12.005440 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3e35d519-0150-4ab5-a9ff-de13c36e184a tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:46:12.014887 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3e35d519-0150-4ab5-a9ff-de13c36e184a tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575" status: 200 len: 1366 microversion: 2.1 time: 0.154076 Jul 15 15:46:12.015457 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 582/1157] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:46:11 2022] GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:46:12.766542 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-97ba4cd0-a4b5-4bd0-8a9c-1d39b5a080c1 req-39b7b919-fc5f-4cdd-8b2b-3f784b10a795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06fef22c-6025-483e-ad3b-7be9cf865575", "name": "network-vif-plugged", "status": "completed", "tag": "b72b9f11-5a73-456f-b8c6-8e42b57e5195"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:46:12.778141 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-97ba4cd0-a4b5-4bd0-8a9c-1d39b5a080c1 req-39b7b919-fc5f-4cdd-8b2b-3f784b10a795 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:12.778792 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-97ba4cd0-a4b5-4bd0-8a9c-1d39b5a080c1 req-39b7b919-fc5f-4cdd-8b2b-3f784b10a795 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:12.793045 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-97ba4cd0-a4b5-4bd0-8a9c-1d39b5a080c1 req-39b7b919-fc5f-4cdd-8b2b-3f784b10a795 service nova] Creating event network-vif-plugged:b72b9f11-5a73-456f-b8c6-8e42b57e5195 for instance 06fef22c-6025-483e-ad3b-7be9cf865575 on hv-cinder-85001 Jul 15 15:46:12.799404 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-97ba4cd0-a4b5-4bd0-8a9c-1d39b5a080c1 req-39b7b919-fc5f-4cdd-8b2b-3f784b10a795 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036958 Jul 15 15:46:12.800295 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 576/1158] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:46:13.032530 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-05fd8e63-e9d7-4ee8-9f1d-30cc00aa63fe tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:13.033156 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-05fd8e63-e9d7-4ee8-9f1d-30cc00aa63fe tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 06fef22c-6025-483e-ad3b-7be9cf865575] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:46:13.040730 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-05fd8e63-e9d7-4ee8-9f1d-30cc00aa63fe tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:13.041163 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-05fd8e63-e9d7-4ee8-9f1d-30cc00aa63fe tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:13.041909 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-05fd8e63-e9d7-4ee8-9f1d-30cc00aa63fe tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:13.042497 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-05fd8e63-e9d7-4ee8-9f1d-30cc00aa63fe tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:13.177057 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-05fd8e63-e9d7-4ee8-9f1d-30cc00aa63fe tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:46:13.185131 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-05fd8e63-e9d7-4ee8-9f1d-30cc00aa63fe tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575" status: 200 len: 1366 microversion: 2.1 time: 0.156661 Jul 15 15:46:13.185714 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 583/1159] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:46:13 2022] GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:46:14.198932 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=2 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:46:14.199800 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=6 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:46:14.204706 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-789cb97f-77c0-4f83-9db0-babaa4d2109d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:14.205409 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-789cb97f-77c0-4f83-9db0-babaa4d2109d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 06fef22c-6025-483e-ad3b-7be9cf865575] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:46:14.212834 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-789cb97f-77c0-4f83-9db0-babaa4d2109d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:14.213274 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-789cb97f-77c0-4f83-9db0-babaa4d2109d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:14.214011 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-789cb97f-77c0-4f83-9db0-babaa4d2109d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:14.214645 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-789cb97f-77c0-4f83-9db0-babaa4d2109d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:14.357704 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-789cb97f-77c0-4f83-9db0-babaa4d2109d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:46:14.365617 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-789cb97f-77c0-4f83-9db0-babaa4d2109d tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575" status: 200 len: 1366 microversion: 2.1 time: 0.167814 Jul 15 15:46:14.366538 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 577/1160] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:46:14 2022] GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:46:15.393713 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1d3df1ea-b938-4f7b-acff-8257f2443530 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:15.394598 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1d3df1ea-b938-4f7b-acff-8257f2443530 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 06fef22c-6025-483e-ad3b-7be9cf865575] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:46:15.396566 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=6 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:46:15.403868 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1d3df1ea-b938-4f7b-acff-8257f2443530 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:15.404296 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1d3df1ea-b938-4f7b-acff-8257f2443530 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:15.405041 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1d3df1ea-b938-4f7b-acff-8257f2443530 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:15.405460 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1d3df1ea-b938-4f7b-acff-8257f2443530 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:15.578919 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1d3df1ea-b938-4f7b-acff-8257f2443530 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:46:15.590731 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1d3df1ea-b938-4f7b-acff-8257f2443530 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575" status: 200 len: 1557 microversion: 2.1 time: 0.201278 Jul 15 15:46:15.591393 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 584/1161] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:46:15 2022] GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575 => generated 1557 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:46:15.608956 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-1e7ee86f-b4c9-416f-b5ee-b98243af58e5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:46:15.609625 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-1e7ee86f-b4c9-416f-b5ee-b98243af58e5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 06fef22c-6025-483e-ad3b-7be9cf865575] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:46:15.617449 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1e7ee86f-b4c9-416f-b5ee-b98243af58e5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:15.617954 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1e7ee86f-b4c9-416f-b5ee-b98243af58e5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:15.618926 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1e7ee86f-b4c9-416f-b5ee-b98243af58e5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:15.619369 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1e7ee86f-b4c9-416f-b5ee-b98243af58e5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:15.701234 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-1e7ee86f-b4c9-416f-b5ee-b98243af58e5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096881 Jul 15 15:46:15.702074 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 578/1162] 10.222.0.40 () {58 vars in 1274 bytes} [Fri Jul 15 15:46:15 2022] GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:46:16.978287 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-ddf00e16-305d-4ad9-a102-09fe35b1d387 req-0252cddd-b1c9-4e27-9f5a-dc39fa86d1df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06fef22c-6025-483e-ad3b-7be9cf865575", "tag": "b72b9f11-5a73-456f-b8c6-8e42b57e5195"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:46:16.989605 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-ddf00e16-305d-4ad9-a102-09fe35b1d387 req-0252cddd-b1c9-4e27-9f5a-dc39fa86d1df service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:46:16.990202 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-ddf00e16-305d-4ad9-a102-09fe35b1d387 req-0252cddd-b1c9-4e27-9f5a-dc39fa86d1df service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:46:17.004226 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-ddf00e16-305d-4ad9-a102-09fe35b1d387 req-0252cddd-b1c9-4e27-9f5a-dc39fa86d1df service nova] Creating event network-changed:b72b9f11-5a73-456f-b8c6-8e42b57e5195 for instance 06fef22c-6025-483e-ad3b-7be9cf865575 on hv-cinder-85001 Jul 15 15:46:17.010099 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-ddf00e16-305d-4ad9-a102-09fe35b1d387 req-0252cddd-b1c9-4e27-9f5a-dc39fa86d1df service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036171 Jul 15 15:46:17.010760 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 585/1163] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:47:33.004054 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:47:33.004792 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=33 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:47:33.009088 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-9b23d07a-0959-44e9-be2d-d8b1d891722f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:47:33.009570 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-9b23d07a-0959-44e9-be2d-d8b1d891722f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 06fef22c-6025-483e-ad3b-7be9cf865575] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:47:33.016997 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9b23d07a-0959-44e9-be2d-d8b1d891722f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:33.017431 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9b23d07a-0959-44e9-be2d-d8b1d891722f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:33.018199 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9b23d07a-0959-44e9-be2d-d8b1d891722f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:33.018648 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9b23d07a-0959-44e9-be2d-d8b1d891722f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:33.046132 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-9b23d07a-0959-44e9-be2d-d8b1d891722f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575/ips" status: 200 len: 151 microversion: 2.1 time: 0.044052 Jul 15 15:47:33.046754 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 579/1164] 10.222.0.40 () {58 vars in 1247 bytes} [Fri Jul 15 15:47:33 2022] GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:47:34.397798 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:47:34.398540 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=37 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:47:34.403166 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-17d43e1f-29b4-4fa6-bad1-231a6881106f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3abd8448-8c2e-4ec5-965e-b937c23ae50e"}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:47:34.404313 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-17d43e1f-29b4-4fa6-bad1-231a6881106f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 06fef22c-6025-483e-ad3b-7be9cf865575] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:47:34.412204 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-17d43e1f-29b4-4fa6-bad1-231a6881106f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:34.412640 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-17d43e1f-29b4-4fa6-bad1-231a6881106f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:34.413407 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-17d43e1f-29b4-4fa6-bad1-231a6881106f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:34.413827 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-17d43e1f-29b4-4fa6-bad1-231a6881106f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:34.887019 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-17d43e1f-29b4-4fa6-bad1-231a6881106f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "POST /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.491147 Jul 15 15:47:34.892108 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 586/1165] 10.222.0.40 () {60 vars in 1322 bytes} [Fri Jul 15 15:47:34 2022] POST /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575/os-volume_attachments => generated 194 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:47:42.517381 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-82d74122-bb6e-465b-9371-dfa54b551cbe tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:47:42.517989 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-82d74122-bb6e-465b-9371-dfa54b551cbe tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 06fef22c-6025-483e-ad3b-7be9cf865575] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:47:42.524210 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-82d74122-bb6e-465b-9371-dfa54b551cbe tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:42.524646 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-82d74122-bb6e-465b-9371-dfa54b551cbe tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:42.525454 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-82d74122-bb6e-465b-9371-dfa54b551cbe tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:42.525879 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-82d74122-bb6e-465b-9371-dfa54b551cbe tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:42.679154 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.objects.instance [None req-82d74122-bb6e-465b-9371-dfa54b551cbe tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lazy-loading 'services' on Instance uuid 06fef22c-6025-483e-ad3b-7be9cf865575 {{(pid=117999) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:47:42.759789 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-82d74122-bb6e-465b-9371-dfa54b551cbe tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "DELETE /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575/os-volume_attachments/3abd8448-8c2e-4ec5-965e-b937c23ae50e" status: 202 len: 0 microversion: 2.1 time: 0.246258 Jul 15 15:47:42.760427 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 580/1166] 10.222.0.40 () {58 vars in 1415 bytes} [Fri Jul 15 15:47:42 2022] DELETE /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575/os-volume_attachments/3abd8448-8c2e-4ec5-965e-b937c23ae50e => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 15:47:42.770699 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ec59bb02-93fd-4a68-ba43-01c9bda6659f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:47:42.771769 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ec59bb02-93fd-4a68-ba43-01c9bda6659f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 06fef22c-6025-483e-ad3b-7be9cf865575] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:47:42.778791 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ec59bb02-93fd-4a68-ba43-01c9bda6659f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:42.779204 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ec59bb02-93fd-4a68-ba43-01c9bda6659f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:42.780198 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ec59bb02-93fd-4a68-ba43-01c9bda6659f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:42.780637 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ec59bb02-93fd-4a68-ba43-01c9bda6659f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:42.813160 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ec59bb02-93fd-4a68-ba43-01c9bda6659f tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047650 Jul 15 15:47:42.813667 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 587/1167] 10.222.0.40 () {58 vars in 1301 bytes} [Fri Jul 15 15:47:42 2022] GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 15:47:43.826181 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-ecb97be4-f8a5-4253-aced-b283aa552ede tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:47:43.827167 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-ecb97be4-f8a5-4253-aced-b283aa552ede tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 06fef22c-6025-483e-ad3b-7be9cf865575] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:47:43.834587 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ecb97be4-f8a5-4253-aced-b283aa552ede tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:43.835048 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ecb97be4-f8a5-4253-aced-b283aa552ede tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:43.836385 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ecb97be4-f8a5-4253-aced-b283aa552ede tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:43.836385 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ecb97be4-f8a5-4253-aced-b283aa552ede tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:43.869180 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-ecb97be4-f8a5-4253-aced-b283aa552ede tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047269 Jul 15 15:47:43.869744 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 581/1168] 10.222.0.40 () {58 vars in 1301 bytes} [Fri Jul 15 15:47:43 2022] GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 15:47:43.930558 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f27aa2e4-4f98-4e10-8ff2-a290da4db032 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:47:43.931138 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f27aa2e4-4f98-4e10-8ff2-a290da4db032 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 06fef22c-6025-483e-ad3b-7be9cf865575] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:47:43.938875 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f27aa2e4-4f98-4e10-8ff2-a290da4db032 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:43.939351 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f27aa2e4-4f98-4e10-8ff2-a290da4db032 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:43.940162 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f27aa2e4-4f98-4e10-8ff2-a290da4db032 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:43.940619 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f27aa2e4-4f98-4e10-8ff2-a290da4db032 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:43.969852 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f27aa2e4-4f98-4e10-8ff2-a290da4db032 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 06fef22c-6025-483e-ad3b-7be9cf865575] Going to try to terminate instance {{(pid=117998) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 15:47:44.070365 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f27aa2e4-4f98-4e10-8ff2-a290da4db032 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "DELETE /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575" status: 204 len: 0 microversion: 2.1 time: 0.143390 Jul 15 15:47:44.071207 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 588/1169] 10.222.0.40 () {58 vars in 1238 bytes} [Fri Jul 15 15:47:43 2022] DELETE /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:47:44.080682 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-2ab7de29-5dec-4d29-8684-4407f02df139 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:47:44.081305 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-2ab7de29-5dec-4d29-8684-4407f02df139 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 06fef22c-6025-483e-ad3b-7be9cf865575] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:47:44.093568 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2ab7de29-5dec-4d29-8684-4407f02df139 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:44.094007 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2ab7de29-5dec-4d29-8684-4407f02df139 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:44.094822 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2ab7de29-5dec-4d29-8684-4407f02df139 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:44.095232 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2ab7de29-5dec-4d29-8684-4407f02df139 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:44.235948 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-2ab7de29-5dec-4d29-8684-4407f02df139 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:47:44.243752 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-2ab7de29-5dec-4d29-8684-4407f02df139 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575" status: 200 len: 1682 microversion: 2.1 time: 0.166931 Jul 15 15:47:44.244638 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 582/1170] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:47:44 2022] GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:47:45.262745 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b03e7d3a-089c-4f2b-a312-e71c08d3a4f2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:47:45.263476 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b03e7d3a-089c-4f2b-a312-e71c08d3a4f2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 06fef22c-6025-483e-ad3b-7be9cf865575] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:47:45.270697 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b03e7d3a-089c-4f2b-a312-e71c08d3a4f2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:45.271137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b03e7d3a-089c-4f2b-a312-e71c08d3a4f2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:45.271903 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b03e7d3a-089c-4f2b-a312-e71c08d3a4f2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:45.272324 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b03e7d3a-089c-4f2b-a312-e71c08d3a4f2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:45.416315 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b03e7d3a-089c-4f2b-a312-e71c08d3a4f2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:47:45.424425 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b03e7d3a-089c-4f2b-a312-e71c08d3a4f2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575" status: 200 len: 1682 microversion: 2.1 time: 0.166401 Jul 15 15:47:45.425007 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 589/1171] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:47:45 2022] GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:47:46.441508 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-44e84563-c255-48f9-a99d-1873be099b36 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:47:46.442141 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-44e84563-c255-48f9-a99d-1873be099b36 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 06fef22c-6025-483e-ad3b-7be9cf865575] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:47:46.449399 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-44e84563-c255-48f9-a99d-1873be099b36 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:46.449989 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-44e84563-c255-48f9-a99d-1873be099b36 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:46.450861 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-44e84563-c255-48f9-a99d-1873be099b36 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:46.451138 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-44e84563-c255-48f9-a99d-1873be099b36 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:46.717494 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-44e84563-c255-48f9-a99d-1873be099b36 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f9a645a6f4ffe8c0518504ed6d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46caece212e44751ba83b3dbfc8176ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:47:46.725532 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-44e84563-c255-48f9-a99d-1873be099b36 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575" status: 200 len: 1682 microversion: 2.1 time: 0.287965 Jul 15 15:47:46.726212 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 583/1172] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:47:46 2022] GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575 => generated 1682 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:47:46.979528 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-771d4e16-9348-41c3-a439-4e1bff3ff08b req-21f6df36-f451-4c73-990e-aa1557f7d4ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06fef22c-6025-483e-ad3b-7be9cf865575", "name": "network-vif-deleted", "tag": "b72b9f11-5a73-456f-b8c6-8e42b57e5195"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:47:46.991637 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-771d4e16-9348-41c3-a439-4e1bff3ff08b req-21f6df36-f451-4c73-990e-aa1557f7d4ea service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:46.992182 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-771d4e16-9348-41c3-a439-4e1bff3ff08b req-21f6df36-f451-4c73-990e-aa1557f7d4ea service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:47.010283 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-771d4e16-9348-41c3-a439-4e1bff3ff08b req-21f6df36-f451-4c73-990e-aa1557f7d4ea service nova] Creating event network-vif-deleted:b72b9f11-5a73-456f-b8c6-8e42b57e5195 for instance 06fef22c-6025-483e-ad3b-7be9cf865575 on hv-cinder-85001 Jul 15 15:47:47.017016 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-771d4e16-9348-41c3-a439-4e1bff3ff08b req-21f6df36-f451-4c73-990e-aa1557f7d4ea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040941 Jul 15 15:47:47.018179 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 590/1173] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:47:47.742559 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-e9c29792-f148-4612-8abc-39eeced3bd95 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:47:47.743170 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-e9c29792-f148-4612-8abc-39eeced3bd95 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 06fef22c-6025-483e-ad3b-7be9cf865575] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:47:47.750311 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e9c29792-f148-4612-8abc-39eeced3bd95 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:47.750774 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e9c29792-f148-4612-8abc-39eeced3bd95 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:47.751531 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e9c29792-f148-4612-8abc-39eeced3bd95 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:47.751950 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e9c29792-f148-4612-8abc-39eeced3bd95 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:47.765828 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.wsgi [None req-e9c29792-f148-4612-8abc-39eeced3bd95 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] HTTP exception thrown: Instance 06fef22c-6025-483e-ad3b-7be9cf865575 could not be found. Jul 15 15:47:47.767551 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-e9c29792-f148-4612-8abc-39eeced3bd95 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Request method failure captured: Jul 15 15:47:47.767551 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: request: GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575 HTTP/1.1 Jul 15 15:47:47.767551 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept: application/json Jul 15 15:47:47.767551 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept-Encoding: identity Jul 15 15:47:47.767551 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Connection: close Jul 15 15:47:47.767551 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Length: 0 Jul 15 15:47:47.767551 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Type: application/json Jul 15 15:47:47.767551 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Host: 10.222.0.40 Jul 15 15:47:47.767551 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Openstack-System-Scope: None Jul 15 15:47:47.767551 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: User-Agent: python-urllib3/1.26.9 Jul 15 15:47:47.767551 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Auth-Token: gAAAAABi0Yo0oWCcSgXmtT-AIlDmriNhuaROhcBGq6ue3L5Dg2A5mO8AU2ZxmGGSNs4xSg3UmnfAZL6PFQuplQb5tQv5obCaLScXfj5NCn3_QAidbr64Xyr4O6TBJXZrgWdTGNpso6LO-VMt9Fp0ms130e_ZCnxRJ6cb7aFMSAyXq4JV2-p6SZA Jul 15 15:47:47.767551 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Id: None Jul 15 15:47:47.767551 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Name: None Jul 15 15:47:47.767551 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Identity-Status: Confirmed Jul 15 15:47:47.767551 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Is-Admin-Project: True Jul 15 15:47:47.767551 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Id: default Jul 15 15:47:47.767551 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Name: Default Jul 15 15:47:47.767551 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Id: 46caece212e44751ba83b3dbfc8176ee Jul 15 15:47:47.767551 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Name: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:47:47.767551 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Role: member,reader Jul 15 15:47:47.767551 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Roles: member,reader Jul 15 15:47:47.769300 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_46caece212e44751ba83b3dbfc8176ee", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:47:47.769300 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:47:47.769300 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Id: 46caece212e44751ba83b3dbfc8176ee Jul 15 15:47:47.769300 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:47:47.769300 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User: tempest-AttachVolumeNegativeTest-461054684-project Jul 15 15:47:47.769300 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Id: default Jul 15 15:47:47.769300 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Name: Default Jul 15 15:47:47.769300 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Id: 862f9a645a6f4ffe8c0518504ed6d47c Jul 15 15:47:47.769300 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Name: tempest-AttachVolumeNegativeTest-461054684-project Jul 15 15:47:47.769300 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: method: > Jul 15 15:47:47.769300 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: exception: Instance 06fef22c-6025-483e-ad3b-7be9cf865575 could not be found. Jul 15 15:47:47.769300 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: action_args: {'id': '06fef22c-6025-483e-ad3b-7be9cf865575'} Jul 15 15:47:47.770400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:47:47.770400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:47:47.770400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:47:47.770400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:47:47.770400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:47:47.770400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:47:47.770400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:47:47.770400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:47:47.770400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:47:47.770400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:47:47.770400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06fef22c-6025-483e-ad3b-7be9cf865575 could not be found. Jul 15 15:47:47.770400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:47:47.770400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:47:47.770400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:47:47.770400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:47:47.770400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:47:47.770400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:47:47.770400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:47:47.770400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:47:47.770400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:47:47.772036 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:47:47.772036 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:47:47.772036 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:47:47.772036 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:47:47.772036 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:47:47.772036 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:47:47.772036 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:47:47.772036 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06fef22c-6025-483e-ad3b-7be9cf865575 could not be found. Jul 15 15:47:47.772036 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:47:47.772036 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:47:47.772036 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:47:47.772036 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:47:47.772036 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:47:47.772036 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:47:47.772036 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:47:47.772036 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:47:47.772036 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06fef22c-6025-483e-ad3b-7be9cf865575 could not be found. Jul 15 15:47:47.772036 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:47:47.773747 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-e9c29792-f148-4612-8abc-39eeced3bd95 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Returning 404 to user: Instance 06fef22c-6025-483e-ad3b-7be9cf865575 could not be found. {{(pid=117999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:47:47.773747 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-e9c29792-f148-4612-8abc-39eeced3bd95 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575" status: 404 len: 111 microversion: 2.1 time: 0.030283 Jul 15 15:47:47.773747 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 584/1174] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:47:47 2022] GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:47:47.779462 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1ef07d99-29fa-45f7-84f9-2448cb932fa2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '.version_select at 0x7fe3c6aaf0d0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:47:47.799298 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1ef07d99-29fa-45f7-84f9-2448cb932fa2 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-691950237" status: 202 len: 0 microversion: 2.1 time: 0.024343 Jul 15 15:47:47.799926 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 591/1175] 10.222.0.40 () {58 vars in 1217 bytes} [Fri Jul 15 15:47:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-691950237 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:47:49.635998 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-d0b23389-d1b6-4cc3-bbdc-db9794712f17 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:47:49.637378 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-d0b23389-d1b6-4cc3-bbdc-db9794712f17 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 06fef22c-6025-483e-ad3b-7be9cf865575] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:47:49.644373 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d0b23389-d1b6-4cc3-bbdc-db9794712f17 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:49.644792 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d0b23389-d1b6-4cc3-bbdc-db9794712f17 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:49.645574 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d0b23389-d1b6-4cc3-bbdc-db9794712f17 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:49.646028 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-d0b23389-d1b6-4cc3-bbdc-db9794712f17 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:49.661833 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.wsgi [None req-d0b23389-d1b6-4cc3-bbdc-db9794712f17 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] HTTP exception thrown: Instance 06fef22c-6025-483e-ad3b-7be9cf865575 could not be found. Jul 15 15:47:49.663550 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-d0b23389-d1b6-4cc3-bbdc-db9794712f17 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Request method failure captured: Jul 15 15:47:49.663550 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: request: DELETE /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575 HTTP/1.1 Jul 15 15:47:49.663550 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept: application/json Jul 15 15:47:49.663550 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept-Encoding: identity Jul 15 15:47:49.663550 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Connection: close Jul 15 15:47:49.663550 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Length: 0 Jul 15 15:47:49.663550 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Type: application/json Jul 15 15:47:49.663550 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Host: 10.222.0.40 Jul 15 15:47:49.663550 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Openstack-System-Scope: None Jul 15 15:47:49.663550 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: User-Agent: python-urllib3/1.26.9 Jul 15 15:47:49.663550 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Auth-Token: gAAAAABi0Yo0oWCcSgXmtT-AIlDmriNhuaROhcBGq6ue3L5Dg2A5mO8AU2ZxmGGSNs4xSg3UmnfAZL6PFQuplQb5tQv5obCaLScXfj5NCn3_QAidbr64Xyr4O6TBJXZrgWdTGNpso6LO-VMt9Fp0ms130e_ZCnxRJ6cb7aFMSAyXq4JV2-p6SZA Jul 15 15:47:49.663550 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Id: None Jul 15 15:47:49.663550 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Name: None Jul 15 15:47:49.663550 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Identity-Status: Confirmed Jul 15 15:47:49.663550 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Is-Admin-Project: True Jul 15 15:47:49.663550 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Id: default Jul 15 15:47:49.663550 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Name: Default Jul 15 15:47:49.663550 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Id: 46caece212e44751ba83b3dbfc8176ee Jul 15 15:47:49.663550 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Name: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:47:49.663550 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Role: member,reader Jul 15 15:47:49.663550 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Roles: member,reader Jul 15 15:47:49.665149 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_46caece212e44751ba83b3dbfc8176ee", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:47:49.665149 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:47:49.665149 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Id: 46caece212e44751ba83b3dbfc8176ee Jul 15 15:47:49.665149 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:47:49.665149 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User: tempest-AttachVolumeNegativeTest-461054684-project Jul 15 15:47:49.665149 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Id: default Jul 15 15:47:49.665149 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Name: Default Jul 15 15:47:49.665149 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Id: 862f9a645a6f4ffe8c0518504ed6d47c Jul 15 15:47:49.665149 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Name: tempest-AttachVolumeNegativeTest-461054684-project Jul 15 15:47:49.665149 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: method: > Jul 15 15:47:49.665149 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: exception: Instance 06fef22c-6025-483e-ad3b-7be9cf865575 could not be found. Jul 15 15:47:49.665149 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: action_args: {'id': '06fef22c-6025-483e-ad3b-7be9cf865575'} Jul 15 15:47:49.669166 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:47:49.669166 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:47:49.669166 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:47:49.669166 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:47:49.669166 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:47:49.669166 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:47:49.669166 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:47:49.669166 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:47:49.669166 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:47:49.669166 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:47:49.669166 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06fef22c-6025-483e-ad3b-7be9cf865575 could not be found. Jul 15 15:47:49.669166 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:47:49.669166 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:47:49.669166 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:47:49.669166 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:47:49.669166 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:47:49.669166 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:47:49.669166 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:47:49.669166 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:47:49.669166 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:47:49.670708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:47:49.670708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 15:47:49.670708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 15:47:49.670708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 15:47:49.670708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 15:47:49.670708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:47:49.670708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:47:49.670708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:47:49.670708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:47:49.670708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06fef22c-6025-483e-ad3b-7be9cf865575 could not be found. Jul 15 15:47:49.670708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:47:49.670708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:47:49.670708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:47:49.670708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:47:49.670708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:47:49.670708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:47:49.670708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:47:49.670708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:47:49.670708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06fef22c-6025-483e-ad3b-7be9cf865575 could not be found. Jul 15 15:47:49.670708 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:47:49.672275 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-d0b23389-d1b6-4cc3-bbdc-db9794712f17 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Returning 404 to user: Instance 06fef22c-6025-483e-ad3b-7be9cf865575 could not be found. {{(pid=117999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:47:49.672275 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-d0b23389-d1b6-4cc3-bbdc-db9794712f17 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "DELETE /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575" status: 404 len: 111 microversion: 2.1 time: 0.035278 Jul 15 15:47:49.672275 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 585/1176] 10.222.0.40 () {58 vars in 1238 bytes} [Fri Jul 15 15:47:49 2022] DELETE /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:47:49.673752 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-66976408-a1ed-4b18-a260-26e0d08a9ffa tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:47:49.674508 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-66976408-a1ed-4b18-a260-26e0d08a9ffa tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 06fef22c-6025-483e-ad3b-7be9cf865575] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:47:49.682311 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-66976408-a1ed-4b18-a260-26e0d08a9ffa tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:49.682861 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-66976408-a1ed-4b18-a260-26e0d08a9ffa tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:49.683898 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-66976408-a1ed-4b18-a260-26e0d08a9ffa tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:49.684324 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-66976408-a1ed-4b18-a260-26e0d08a9ffa tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:49.698970 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-66976408-a1ed-4b18-a260-26e0d08a9ffa tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] HTTP exception thrown: Instance 06fef22c-6025-483e-ad3b-7be9cf865575 could not be found. Jul 15 15:47:49.700758 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-66976408-a1ed-4b18-a260-26e0d08a9ffa tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Request method failure captured: Jul 15 15:47:49.700758 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575 HTTP/1.1 Jul 15 15:47:49.700758 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:47:49.700758 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:47:49.700758 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:47:49.700758 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 15 15:47:49.700758 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:47:49.700758 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:47:49.700758 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:47:49.700758 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:47:49.700758 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0Yo0oWCcSgXmtT-AIlDmriNhuaROhcBGq6ue3L5Dg2A5mO8AU2ZxmGGSNs4xSg3UmnfAZL6PFQuplQb5tQv5obCaLScXfj5NCn3_QAidbr64Xyr4O6TBJXZrgWdTGNpso6LO-VMt9Fp0ms130e_ZCnxRJ6cb7aFMSAyXq4JV2-p6SZA Jul 15 15:47:49.700758 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:47:49.700758 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:47:49.700758 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:47:49.700758 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:47:49.700758 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:47:49.700758 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:47:49.700758 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: 46caece212e44751ba83b3dbfc8176ee Jul 15 15:47:49.700758 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:47:49.700758 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:47:49.700758 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:47:49.703204 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_46caece212e44751ba83b3dbfc8176ee", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:47:49.703204 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:47:49.703204 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 46caece212e44751ba83b3dbfc8176ee Jul 15 15:47:49.703204 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:47:49.703204 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-AttachVolumeNegativeTest-461054684-project Jul 15 15:47:49.703204 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:47:49.703204 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:47:49.703204 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: 862f9a645a6f4ffe8c0518504ed6d47c Jul 15 15:47:49.703204 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-AttachVolumeNegativeTest-461054684-project Jul 15 15:47:49.703204 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: > Jul 15 15:47:49.703204 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Instance 06fef22c-6025-483e-ad3b-7be9cf865575 could not be found. Jul 15 15:47:49.703204 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'id': '06fef22c-6025-483e-ad3b-7be9cf865575'} Jul 15 15:47:49.704686 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:47:49.704686 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:47:49.704686 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:47:49.704686 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:47:49.704686 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:47:49.704686 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:47:49.704686 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:47:49.704686 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:47:49.704686 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:47:49.704686 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:47:49.704686 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06fef22c-6025-483e-ad3b-7be9cf865575 could not be found. Jul 15 15:47:49.704686 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:47:49.704686 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:47:49.704686 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:47:49.704686 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:47:49.704686 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:47:49.704686 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:47:49.704686 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:47:49.704686 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:47:49.704686 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:47:49.707252 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:47:49.707252 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:47:49.707252 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:47:49.707252 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:47:49.707252 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:47:49.707252 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:47:49.707252 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:47:49.707252 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06fef22c-6025-483e-ad3b-7be9cf865575 could not be found. Jul 15 15:47:49.707252 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:47:49.707252 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:47:49.707252 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:47:49.707252 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:47:49.707252 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:47:49.707252 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:47:49.707252 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:47:49.707252 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:47:49.707252 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06fef22c-6025-483e-ad3b-7be9cf865575 could not be found. Jul 15 15:47:49.707252 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:47:49.709387 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-66976408-a1ed-4b18-a260-26e0d08a9ffa tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Returning 404 to user: Instance 06fef22c-6025-483e-ad3b-7be9cf865575 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:47:49.709387 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-66976408-a1ed-4b18-a260-26e0d08a9ffa tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575" status: 404 len: 111 microversion: 2.1 time: 0.032270 Jul 15 15:47:49.709387 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 592/1177] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:47:49 2022] GET /compute/v2.1/servers/06fef22c-6025-483e-ad3b-7be9cf865575 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:47:50.852349 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-a96bab07-c75e-493e-9a75-b26d6332b6e1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:47:50.852978 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-a96bab07-c75e-493e-9a75-b26d6332b6e1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:47:50.859868 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a96bab07-c75e-493e-9a75-b26d6332b6e1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:50.860305 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a96bab07-c75e-493e-9a75-b26d6332b6e1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:50.861063 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a96bab07-c75e-493e-9a75-b26d6332b6e1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:50.861547 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a96bab07-c75e-493e-9a75-b26d6332b6e1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:50.876149 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.wsgi [None req-a96bab07-c75e-493e-9a75-b26d6332b6e1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] HTTP exception thrown: Instance da284fff-90a0-4533-b0ab-3946a528adb5 could not be found. Jul 15 15:47:50.877717 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-a96bab07-c75e-493e-9a75-b26d6332b6e1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Request method failure captured: Jul 15 15:47:50.877717 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: request: DELETE /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5 HTTP/1.1 Jul 15 15:47:50.877717 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept: application/json Jul 15 15:47:50.877717 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept-Encoding: identity Jul 15 15:47:50.877717 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Connection: close Jul 15 15:47:50.877717 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Length: 0 Jul 15 15:47:50.877717 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Type: application/json Jul 15 15:47:50.877717 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Host: 10.222.0.40 Jul 15 15:47:50.877717 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Openstack-System-Scope: None Jul 15 15:47:50.877717 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: User-Agent: python-urllib3/1.26.9 Jul 15 15:47:50.877717 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Auth-Token: gAAAAABi0Yo0oWCcSgXmtT-AIlDmriNhuaROhcBGq6ue3L5Dg2A5mO8AU2ZxmGGSNs4xSg3UmnfAZL6PFQuplQb5tQv5obCaLScXfj5NCn3_QAidbr64Xyr4O6TBJXZrgWdTGNpso6LO-VMt9Fp0ms130e_ZCnxRJ6cb7aFMSAyXq4JV2-p6SZA Jul 15 15:47:50.877717 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Id: None Jul 15 15:47:50.877717 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Name: None Jul 15 15:47:50.877717 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Identity-Status: Confirmed Jul 15 15:47:50.877717 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Is-Admin-Project: True Jul 15 15:47:50.877717 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Id: default Jul 15 15:47:50.877717 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Name: Default Jul 15 15:47:50.877717 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Id: 46caece212e44751ba83b3dbfc8176ee Jul 15 15:47:50.877717 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Name: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:47:50.877717 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Role: member,reader Jul 15 15:47:50.877717 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Roles: member,reader Jul 15 15:47:50.879413 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_46caece212e44751ba83b3dbfc8176ee", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:47:50.879413 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:47:50.879413 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Id: 46caece212e44751ba83b3dbfc8176ee Jul 15 15:47:50.879413 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:47:50.879413 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User: tempest-AttachVolumeNegativeTest-461054684-project Jul 15 15:47:50.879413 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Id: default Jul 15 15:47:50.879413 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Name: Default Jul 15 15:47:50.879413 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Id: 862f9a645a6f4ffe8c0518504ed6d47c Jul 15 15:47:50.879413 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Name: tempest-AttachVolumeNegativeTest-461054684-project Jul 15 15:47:50.879413 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: method: > Jul 15 15:47:50.879413 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: exception: Instance da284fff-90a0-4533-b0ab-3946a528adb5 could not be found. Jul 15 15:47:50.879413 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: action_args: {'id': 'da284fff-90a0-4533-b0ab-3946a528adb5'} Jul 15 15:47:50.880536 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:47:50.880536 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:47:50.880536 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:47:50.880536 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:47:50.880536 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:47:50.880536 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:47:50.880536 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:47:50.880536 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:47:50.880536 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:47:50.880536 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:47:50.880536 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da284fff-90a0-4533-b0ab-3946a528adb5 could not be found. Jul 15 15:47:50.880536 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:47:50.880536 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:47:50.880536 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:47:50.880536 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:47:50.880536 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:47:50.880536 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:47:50.880536 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:47:50.880536 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:47:50.880536 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:47:50.881888 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:47:50.881888 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 15:47:50.881888 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 15:47:50.881888 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 15:47:50.881888 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 15:47:50.881888 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:47:50.881888 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:47:50.881888 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:47:50.881888 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:47:50.881888 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da284fff-90a0-4533-b0ab-3946a528adb5 could not be found. Jul 15 15:47:50.881888 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:47:50.881888 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:47:50.881888 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:47:50.881888 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:47:50.881888 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:47:50.881888 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:47:50.881888 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:47:50.881888 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:47:50.881888 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da284fff-90a0-4533-b0ab-3946a528adb5 could not be found. Jul 15 15:47:50.881888 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:47:50.883468 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-a96bab07-c75e-493e-9a75-b26d6332b6e1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Returning 404 to user: Instance da284fff-90a0-4533-b0ab-3946a528adb5 could not be found. {{(pid=117999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:47:50.883468 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-a96bab07-c75e-493e-9a75-b26d6332b6e1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "DELETE /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5" status: 404 len: 111 microversion: 2.1 time: 0.030687 Jul 15 15:47:50.883468 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 586/1178] 10.222.0.40 () {58 vars in 1238 bytes} [Fri Jul 15 15:47:50 2022] DELETE /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:47:50.887955 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-aea109ed-1a25-4d45-8400-739189d35716 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:47:50.888667 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-aea109ed-1a25-4d45-8400-739189d35716 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: da284fff-90a0-4533-b0ab-3946a528adb5] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:47:50.895452 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aea109ed-1a25-4d45-8400-739189d35716 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:50.895890 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aea109ed-1a25-4d45-8400-739189d35716 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:50.896658 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aea109ed-1a25-4d45-8400-739189d35716 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:50.897080 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aea109ed-1a25-4d45-8400-739189d35716 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:50.913722 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-aea109ed-1a25-4d45-8400-739189d35716 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] HTTP exception thrown: Instance da284fff-90a0-4533-b0ab-3946a528adb5 could not be found. Jul 15 15:47:50.915318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-aea109ed-1a25-4d45-8400-739189d35716 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Request method failure captured: Jul 15 15:47:50.915318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5 HTTP/1.1 Jul 15 15:47:50.915318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:47:50.915318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:47:50.915318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:47:50.915318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 15 15:47:50.915318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:47:50.915318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:47:50.915318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:47:50.915318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:47:50.915318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0Yo0oWCcSgXmtT-AIlDmriNhuaROhcBGq6ue3L5Dg2A5mO8AU2ZxmGGSNs4xSg3UmnfAZL6PFQuplQb5tQv5obCaLScXfj5NCn3_QAidbr64Xyr4O6TBJXZrgWdTGNpso6LO-VMt9Fp0ms130e_ZCnxRJ6cb7aFMSAyXq4JV2-p6SZA Jul 15 15:47:50.915318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:47:50.915318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:47:50.915318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:47:50.915318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:47:50.915318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:47:50.915318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:47:50.915318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: 46caece212e44751ba83b3dbfc8176ee Jul 15 15:47:50.915318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:47:50.915318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:47:50.915318 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:47:50.917006 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_46caece212e44751ba83b3dbfc8176ee", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:47:50.917006 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:47:50.917006 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 46caece212e44751ba83b3dbfc8176ee Jul 15 15:47:50.917006 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:47:50.917006 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-AttachVolumeNegativeTest-461054684-project Jul 15 15:47:50.917006 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:47:50.917006 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:47:50.917006 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: 862f9a645a6f4ffe8c0518504ed6d47c Jul 15 15:47:50.917006 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-AttachVolumeNegativeTest-461054684-project Jul 15 15:47:50.917006 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: > Jul 15 15:47:50.917006 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Instance da284fff-90a0-4533-b0ab-3946a528adb5 could not be found. Jul 15 15:47:50.917006 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'id': 'da284fff-90a0-4533-b0ab-3946a528adb5'} Jul 15 15:47:50.918125 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:47:50.918125 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:47:50.918125 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:47:50.918125 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:47:50.918125 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:47:50.918125 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:47:50.918125 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:47:50.918125 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:47:50.918125 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:47:50.918125 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:47:50.918125 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da284fff-90a0-4533-b0ab-3946a528adb5 could not be found. Jul 15 15:47:50.918125 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:47:50.918125 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:47:50.918125 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:47:50.918125 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:47:50.918125 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:47:50.918125 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:47:50.918125 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:47:50.918125 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:47:50.918125 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:47:50.919739 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:47:50.919739 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:47:50.919739 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:47:50.919739 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:47:50.919739 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:47:50.919739 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:47:50.919739 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:47:50.919739 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da284fff-90a0-4533-b0ab-3946a528adb5 could not be found. Jul 15 15:47:50.919739 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:47:50.919739 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:47:50.919739 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:47:50.919739 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:47:50.919739 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:47:50.919739 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:47:50.919739 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:47:50.919739 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:47:50.919739 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da284fff-90a0-4533-b0ab-3946a528adb5 could not be found. Jul 15 15:47:50.919739 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:47:50.921257 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-aea109ed-1a25-4d45-8400-739189d35716 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Returning 404 to user: Instance da284fff-90a0-4533-b0ab-3946a528adb5 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:47:50.921257 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-aea109ed-1a25-4d45-8400-739189d35716 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5" status: 404 len: 111 microversion: 2.1 time: 0.032678 Jul 15 15:47:50.921257 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 593/1179] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:47:50 2022] GET /compute/v2.1/servers/da284fff-90a0-4533-b0ab-3946a528adb5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:47:50.925348 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-b23c003f-03a1-41b7-8a2b-24c8f41f84a5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:47:50.925839 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-b23c003f-03a1-41b7-8a2b-24c8f41f84a5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:47:50.932169 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b23c003f-03a1-41b7-8a2b-24c8f41f84a5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:50.933004 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b23c003f-03a1-41b7-8a2b-24c8f41f84a5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:50.933426 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b23c003f-03a1-41b7-8a2b-24c8f41f84a5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:50.933852 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b23c003f-03a1-41b7-8a2b-24c8f41f84a5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:50.949737 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.wsgi [None req-b23c003f-03a1-41b7-8a2b-24c8f41f84a5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] HTTP exception thrown: Instance 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d could not be found. Jul 15 15:47:50.951331 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-b23c003f-03a1-41b7-8a2b-24c8f41f84a5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Request method failure captured: Jul 15 15:47:50.951331 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: request: DELETE /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d HTTP/1.1 Jul 15 15:47:50.951331 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept: application/json Jul 15 15:47:50.951331 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept-Encoding: identity Jul 15 15:47:50.951331 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Connection: close Jul 15 15:47:50.951331 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Length: 0 Jul 15 15:47:50.951331 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Type: application/json Jul 15 15:47:50.951331 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Host: 10.222.0.40 Jul 15 15:47:50.951331 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Openstack-System-Scope: None Jul 15 15:47:50.951331 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: User-Agent: python-urllib3/1.26.9 Jul 15 15:47:50.951331 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Auth-Token: gAAAAABi0Yo0oWCcSgXmtT-AIlDmriNhuaROhcBGq6ue3L5Dg2A5mO8AU2ZxmGGSNs4xSg3UmnfAZL6PFQuplQb5tQv5obCaLScXfj5NCn3_QAidbr64Xyr4O6TBJXZrgWdTGNpso6LO-VMt9Fp0ms130e_ZCnxRJ6cb7aFMSAyXq4JV2-p6SZA Jul 15 15:47:50.951331 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Id: None Jul 15 15:47:50.951331 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Name: None Jul 15 15:47:50.951331 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Identity-Status: Confirmed Jul 15 15:47:50.951331 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Is-Admin-Project: True Jul 15 15:47:50.951331 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Id: default Jul 15 15:47:50.951331 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Name: Default Jul 15 15:47:50.951331 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Id: 46caece212e44751ba83b3dbfc8176ee Jul 15 15:47:50.951331 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Name: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:47:50.951331 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Role: member,reader Jul 15 15:47:50.951331 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Roles: member,reader Jul 15 15:47:50.952816 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_46caece212e44751ba83b3dbfc8176ee", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:47:50.952816 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:47:50.952816 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Id: 46caece212e44751ba83b3dbfc8176ee Jul 15 15:47:50.952816 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:47:50.952816 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User: tempest-AttachVolumeNegativeTest-461054684-project Jul 15 15:47:50.952816 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Id: default Jul 15 15:47:50.952816 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Name: Default Jul 15 15:47:50.952816 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Id: 862f9a645a6f4ffe8c0518504ed6d47c Jul 15 15:47:50.952816 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Name: tempest-AttachVolumeNegativeTest-461054684-project Jul 15 15:47:50.952816 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: method: > Jul 15 15:47:50.952816 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: exception: Instance 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d could not be found. Jul 15 15:47:50.952816 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: action_args: {'id': '85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d'} Jul 15 15:47:50.953611 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:47:50.953611 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:47:50.953611 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:47:50.953611 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:47:50.953611 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:47:50.953611 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:47:50.953611 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:47:50.953611 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:47:50.953611 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:47:50.953611 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:47:50.953611 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d could not be found. Jul 15 15:47:50.953611 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:47:50.953611 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:47:50.953611 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:47:50.953611 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:47:50.953611 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:47:50.953611 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:47:50.953611 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:47:50.953611 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:47:50.953611 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:47:50.955039 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:47:50.955039 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 15:47:50.955039 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 15:47:50.955039 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 15:47:50.955039 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 15:47:50.955039 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:47:50.955039 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:47:50.955039 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:47:50.955039 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:47:50.955039 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d could not be found. Jul 15 15:47:50.955039 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:47:50.955039 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:47:50.955039 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:47:50.955039 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:47:50.955039 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:47:50.955039 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:47:50.955039 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:47:50.955039 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:47:50.955039 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d could not be found. Jul 15 15:47:50.955039 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:47:50.956625 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-b23c003f-03a1-41b7-8a2b-24c8f41f84a5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Returning 404 to user: Instance 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d could not be found. {{(pid=117999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:47:50.956625 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-b23c003f-03a1-41b7-8a2b-24c8f41f84a5 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "DELETE /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d" status: 404 len: 111 microversion: 2.1 time: 0.031283 Jul 15 15:47:50.956625 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 587/1180] 10.222.0.40 () {58 vars in 1238 bytes} [Fri Jul 15 15:47:50 2022] DELETE /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:47:50.961469 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-064e1603-95b9-404d-8ef4-d9ae0eca971c tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:47:50.962067 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-064e1603-95b9-404d-8ef4-d9ae0eca971c tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:47:50.968670 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-064e1603-95b9-404d-8ef4-d9ae0eca971c tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:50.969132 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-064e1603-95b9-404d-8ef4-d9ae0eca971c tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:50.969875 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-064e1603-95b9-404d-8ef4-d9ae0eca971c tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:50.970298 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-064e1603-95b9-404d-8ef4-d9ae0eca971c tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:50.984321 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-064e1603-95b9-404d-8ef4-d9ae0eca971c tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] HTTP exception thrown: Instance 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d could not be found. Jul 15 15:47:50.985864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-064e1603-95b9-404d-8ef4-d9ae0eca971c tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Request method failure captured: Jul 15 15:47:50.985864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d HTTP/1.1 Jul 15 15:47:50.985864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:47:50.985864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:47:50.985864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:47:50.985864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 15 15:47:50.985864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:47:50.985864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:47:50.985864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:47:50.985864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:47:50.985864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0Yo0oWCcSgXmtT-AIlDmriNhuaROhcBGq6ue3L5Dg2A5mO8AU2ZxmGGSNs4xSg3UmnfAZL6PFQuplQb5tQv5obCaLScXfj5NCn3_QAidbr64Xyr4O6TBJXZrgWdTGNpso6LO-VMt9Fp0ms130e_ZCnxRJ6cb7aFMSAyXq4JV2-p6SZA Jul 15 15:47:50.985864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:47:50.985864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:47:50.985864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:47:50.985864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:47:50.985864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:47:50.985864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:47:50.985864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: 46caece212e44751ba83b3dbfc8176ee Jul 15 15:47:50.985864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:47:50.985864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:47:50.985864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:47:50.987650 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_46caece212e44751ba83b3dbfc8176ee", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:47:50.987650 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:47:50.987650 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 46caece212e44751ba83b3dbfc8176ee Jul 15 15:47:50.987650 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:47:50.987650 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-AttachVolumeNegativeTest-461054684-project Jul 15 15:47:50.987650 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:47:50.987650 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:47:50.987650 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: 862f9a645a6f4ffe8c0518504ed6d47c Jul 15 15:47:50.987650 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-AttachVolumeNegativeTest-461054684-project Jul 15 15:47:50.987650 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: > Jul 15 15:47:50.987650 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Instance 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d could not be found. Jul 15 15:47:50.987650 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'id': '85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d'} Jul 15 15:47:50.988576 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:47:50.988576 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:47:50.988576 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:47:50.988576 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:47:50.988576 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:47:50.988576 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:47:50.988576 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:47:50.988576 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:47:50.988576 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:47:50.988576 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:47:50.988576 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d could not be found. Jul 15 15:47:50.988576 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:47:50.988576 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:47:50.988576 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:47:50.988576 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:47:50.988576 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:47:50.988576 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:47:50.988576 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:47:50.988576 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:47:50.988576 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:47:50.990200 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:47:50.990200 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:47:50.990200 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:47:50.990200 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:47:50.990200 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:47:50.990200 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:47:50.990200 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:47:50.990200 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d could not be found. Jul 15 15:47:50.990200 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:47:50.990200 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:47:50.990200 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:47:50.990200 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:47:50.990200 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:47:50.990200 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:47:50.990200 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:47:50.990200 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:47:50.990200 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d could not be found. Jul 15 15:47:50.990200 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:47:50.991656 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-064e1603-95b9-404d-8ef4-d9ae0eca971c tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Returning 404 to user: Instance 85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:47:50.991656 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-064e1603-95b9-404d-8ef4-d9ae0eca971c tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d" status: 404 len: 111 microversion: 2.1 time: 0.029706 Jul 15 15:47:50.991656 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 594/1181] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:47:50 2022] GET /compute/v2.1/servers/85bb7ef9-4d3a-4711-8bcc-ea7479f33d9d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:47:52.137048 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-90a5ce17-2b75-4cc2-9a44-afc6e62f1eee tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:47:52.137643 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-90a5ce17-2b75-4cc2-9a44-afc6e62f1eee tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:47:52.144881 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-90a5ce17-2b75-4cc2-9a44-afc6e62f1eee tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:52.145319 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-90a5ce17-2b75-4cc2-9a44-afc6e62f1eee tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:52.146076 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-90a5ce17-2b75-4cc2-9a44-afc6e62f1eee tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:52.146503 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-90a5ce17-2b75-4cc2-9a44-afc6e62f1eee tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:52.161327 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.wsgi [None req-90a5ce17-2b75-4cc2-9a44-afc6e62f1eee tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] HTTP exception thrown: Instance 21725c3f-9223-4166-ab4e-58710b60743b could not be found. Jul 15 15:47:52.162929 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-90a5ce17-2b75-4cc2-9a44-afc6e62f1eee tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Request method failure captured: Jul 15 15:47:52.162929 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: request: DELETE /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b HTTP/1.1 Jul 15 15:47:52.162929 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept: application/json Jul 15 15:47:52.162929 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept-Encoding: identity Jul 15 15:47:52.162929 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Connection: close Jul 15 15:47:52.162929 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Length: 0 Jul 15 15:47:52.162929 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Type: application/json Jul 15 15:47:52.162929 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Host: 10.222.0.40 Jul 15 15:47:52.162929 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Openstack-System-Scope: None Jul 15 15:47:52.162929 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: User-Agent: python-urllib3/1.26.9 Jul 15 15:47:52.162929 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Auth-Token: gAAAAABi0Yo0oWCcSgXmtT-AIlDmriNhuaROhcBGq6ue3L5Dg2A5mO8AU2ZxmGGSNs4xSg3UmnfAZL6PFQuplQb5tQv5obCaLScXfj5NCn3_QAidbr64Xyr4O6TBJXZrgWdTGNpso6LO-VMt9Fp0ms130e_ZCnxRJ6cb7aFMSAyXq4JV2-p6SZA Jul 15 15:47:52.162929 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Id: None Jul 15 15:47:52.162929 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Name: None Jul 15 15:47:52.162929 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Identity-Status: Confirmed Jul 15 15:47:52.162929 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Is-Admin-Project: True Jul 15 15:47:52.162929 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Id: default Jul 15 15:47:52.162929 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Name: Default Jul 15 15:47:52.162929 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Id: 46caece212e44751ba83b3dbfc8176ee Jul 15 15:47:52.162929 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Name: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:47:52.162929 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Role: member,reader Jul 15 15:47:52.162929 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Roles: member,reader Jul 15 15:47:52.164642 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_46caece212e44751ba83b3dbfc8176ee", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:47:52.164642 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:47:52.164642 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Id: 46caece212e44751ba83b3dbfc8176ee Jul 15 15:47:52.164642 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:47:52.164642 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User: tempest-AttachVolumeNegativeTest-461054684-project Jul 15 15:47:52.164642 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Id: default Jul 15 15:47:52.164642 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Name: Default Jul 15 15:47:52.164642 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Id: 862f9a645a6f4ffe8c0518504ed6d47c Jul 15 15:47:52.164642 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Name: tempest-AttachVolumeNegativeTest-461054684-project Jul 15 15:47:52.164642 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: method: > Jul 15 15:47:52.164642 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: exception: Instance 21725c3f-9223-4166-ab4e-58710b60743b could not be found. Jul 15 15:47:52.164642 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: action_args: {'id': '21725c3f-9223-4166-ab4e-58710b60743b'} Jul 15 15:47:52.165440 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:47:52.165440 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:47:52.165440 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:47:52.165440 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:47:52.165440 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:47:52.165440 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:47:52.165440 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:47:52.165440 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:47:52.165440 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:47:52.165440 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:47:52.165440 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21725c3f-9223-4166-ab4e-58710b60743b could not be found. Jul 15 15:47:52.165440 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:47:52.165440 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:47:52.165440 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:47:52.165440 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:47:52.165440 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:47:52.165440 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:47:52.165440 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:47:52.165440 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:47:52.165440 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:47:52.166803 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:47:52.166803 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 15:47:52.166803 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 15:47:52.166803 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 15:47:52.166803 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 15:47:52.166803 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:47:52.166803 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:47:52.166803 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:47:52.166803 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:47:52.166803 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21725c3f-9223-4166-ab4e-58710b60743b could not be found. Jul 15 15:47:52.166803 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:47:52.166803 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:47:52.166803 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:47:52.166803 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:47:52.166803 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:47:52.166803 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:47:52.166803 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:47:52.166803 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:47:52.166803 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21725c3f-9223-4166-ab4e-58710b60743b could not be found. Jul 15 15:47:52.166803 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:47:52.168400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-90a5ce17-2b75-4cc2-9a44-afc6e62f1eee tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Returning 404 to user: Instance 21725c3f-9223-4166-ab4e-58710b60743b could not be found. {{(pid=117999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:47:52.168400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-90a5ce17-2b75-4cc2-9a44-afc6e62f1eee tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "DELETE /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b" status: 404 len: 111 microversion: 2.1 time: 0.031303 Jul 15 15:47:52.168400 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 588/1182] 10.222.0.40 () {58 vars in 1238 bytes} [Fri Jul 15 15:47:52 2022] DELETE /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:47:52.173396 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8bc98a02-c3d0-4b5c-af37-b0167ced5ba1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:47:52.174018 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8bc98a02-c3d0-4b5c-af37-b0167ced5ba1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] [instance: 21725c3f-9223-4166-ab4e-58710b60743b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:47:52.180814 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8bc98a02-c3d0-4b5c-af37-b0167ced5ba1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:52.181226 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8bc98a02-c3d0-4b5c-af37-b0167ced5ba1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:52.181974 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8bc98a02-c3d0-4b5c-af37-b0167ced5ba1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:47:52.182388 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8bc98a02-c3d0-4b5c-af37-b0167ced5ba1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:47:52.196650 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-8bc98a02-c3d0-4b5c-af37-b0167ced5ba1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] HTTP exception thrown: Instance 21725c3f-9223-4166-ab4e-58710b60743b could not be found. Jul 15 15:47:52.198118 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8bc98a02-c3d0-4b5c-af37-b0167ced5ba1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Request method failure captured: Jul 15 15:47:52.198118 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b HTTP/1.1 Jul 15 15:47:52.198118 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 15 15:47:52.198118 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 15 15:47:52.198118 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Connection: close Jul 15 15:47:52.198118 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 15 15:47:52.198118 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 15 15:47:52.198118 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Host: 10.222.0.40 Jul 15 15:47:52.198118 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 15 15:47:52.198118 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 15 15:47:52.198118 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABi0Yo0oWCcSgXmtT-AIlDmriNhuaROhcBGq6ue3L5Dg2A5mO8AU2ZxmGGSNs4xSg3UmnfAZL6PFQuplQb5tQv5obCaLScXfj5NCn3_QAidbr64Xyr4O6TBJXZrgWdTGNpso6LO-VMt9Fp0ms130e_ZCnxRJ6cb7aFMSAyXq4JV2-p6SZA Jul 15 15:47:52.198118 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 15 15:47:52.198118 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 15 15:47:52.198118 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 15 15:47:52.198118 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 15 15:47:52.198118 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 15 15:47:52.198118 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 15 15:47:52.198118 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Id: 46caece212e44751ba83b3dbfc8176ee Jul 15 15:47:52.198118 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:47:52.198118 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 15 15:47:52.198118 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 15 15:47:52.200092 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_46caece212e44751ba83b3dbfc8176ee", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/46caece212e44751ba83b3dbfc8176ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:47:52.200092 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:47:52.200092 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 46caece212e44751ba83b3dbfc8176ee Jul 15 15:47:52.200092 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-461054684 Jul 15 15:47:52.200092 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User: tempest-AttachVolumeNegativeTest-461054684-project Jul 15 15:47:52.200092 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 15 15:47:52.200092 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 15 15:47:52.200092 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Id: 862f9a645a6f4ffe8c0518504ed6d47c Jul 15 15:47:52.200092 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-AttachVolumeNegativeTest-461054684-project Jul 15 15:47:52.200092 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: method: > Jul 15 15:47:52.200092 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: exception: Instance 21725c3f-9223-4166-ab4e-58710b60743b could not be found. Jul 15 15:47:52.200092 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: action_args: {'id': '21725c3f-9223-4166-ab4e-58710b60743b'} Jul 15 15:47:52.201008 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:47:52.201008 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:47:52.201008 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:47:52.201008 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:47:52.201008 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:47:52.201008 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:47:52.201008 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:47:52.201008 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:47:52.201008 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:47:52.201008 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:47:52.201008 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21725c3f-9223-4166-ab4e-58710b60743b could not be found. Jul 15 15:47:52.201008 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:47:52.201008 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:47:52.201008 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:47:52.201008 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:47:52.201008 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:47:52.201008 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:47:52.201008 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:47:52.201008 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:47:52.201008 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:47:52.202617 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:47:52.202617 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:47:52.202617 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:47:52.202617 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:47:52.202617 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:47:52.202617 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:47:52.202617 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:47:52.202617 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21725c3f-9223-4166-ab4e-58710b60743b could not be found. Jul 15 15:47:52.202617 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:47:52.202617 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:47:52.202617 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:47:52.202617 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:47:52.202617 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:47:52.202617 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:47:52.202617 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:47:52.202617 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:47:52.202617 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21725c3f-9223-4166-ab4e-58710b60743b could not be found. Jul 15 15:47:52.202617 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 15 15:47:52.204134 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8bc98a02-c3d0-4b5c-af37-b0167ced5ba1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] Returning 404 to user: Instance 21725c3f-9223-4166-ab4e-58710b60743b could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:47:52.204134 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8bc98a02-c3d0-4b5c-af37-b0167ced5ba1 tempest-AttachVolumeNegativeTest-461054684 tempest-AttachVolumeNegativeTest-461054684-project] 10.222.0.40 "GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b" status: 404 len: 111 microversion: 2.1 time: 0.030347 Jul 15 15:47:52.204134 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 595/1183] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:47:52 2022] GET /compute/v2.1/servers/21725c3f-9223-4166-ab4e-58710b60743b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:48:09.071664 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 15:48:09.072369 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Fri Jul 15 15:48:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 15:49:27.077768 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=20 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:49:27.079010 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:49:27.301467 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-22610987-84af-4e25-b341-381db9ba58e4 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Action: 'create', calling method: .version_select at 0x7fe3c66e2670>, body: {"keypair": {"name": "tempest-TestShelveInstance-455271369", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAALi3YsrTzctvM12gMAOLpsF7uJU+JthoyyndHqEx8hIVsQqGs+2hQJwPr2ZJqjwFToZI1LpJF2FkJOOYZSR3RjE+pEjFAL3ieMqfdtf7t4J7/Jr4itj9rtxv8Jd3Q93Q=="}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:49:27.316623 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-22610987-84af-4e25-b341-381db9ba58e4 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Getting quotas for project b031042c48094fdcba11a1a647323b94. Resources: {'key_pairs'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:49:27.321208 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.quota [None req-22610987-84af-4e25-b341-381db9ba58e4 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Getting quotas for user af392d5574cd41399105a3ef96f6d0cf and project b031042c48094fdcba11a1a647323b94. Resources: {'key_pairs'} {{(pid=117999) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:49:27.350763 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-22610987-84af-4e25-b341-381db9ba58e4 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.274881 Jul 15 15:49:27.354069 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 589/1184] 10.222.0.40 () {60 vars in 1158 bytes} [Fri Jul 15 15:49:27 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:49:49.997045 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:49:49.997863 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:49:50.002389 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-aec52c8a-e40f-4638-bf85-1039ceaae7cf tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1267461655", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-455271369", "security_groups": [{"name": "tempest-secgroup-smoke-307778870"}], "networks": [{"uuid": "857de7d8-ab53-430a-8d03-f8affeee709a"}], "block_device_mapping_v2": [{"uuid": "f6955d8c-de2a-41d4-a8b3-77993f8cdc89", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:49:50.120403 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.network.neutron [None req-aec52c8a-e40f-4638-bf85-1039ceaae7cf tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] validate_networks() for [('857de7d8-ab53-430a-8d03-f8affeee709a', None, None, None, None, None)] {{(pid=117998) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 15:49:50.630068 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-aec52c8a-e40f-4638-bf85-1039ceaae7cf tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Flavor limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 15:49:50.630952 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-aec52c8a-e40f-4638-bf85-1039ceaae7cf tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Image limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 15:49:50.631499 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-aec52c8a-e40f-4638-bf85-1039ceaae7cf tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Flavor pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 15:49:50.631910 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-aec52c8a-e40f-4638-bf85-1039ceaae7cf tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Image pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 15:49:50.632316 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-aec52c8a-e40f-4638-bf85-1039ceaae7cf tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 15:49:50.642954 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aec52c8a-e40f-4638-bf85-1039ceaae7cf tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:49:50.643392 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aec52c8a-e40f-4638-bf85-1039ceaae7cf tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:49:50.644188 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aec52c8a-e40f-4638-bf85-1039ceaae7cf tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:49:50.644617 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aec52c8a-e40f-4638-bf85-1039ceaae7cf tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:49:50.663085 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-aec52c8a-e40f-4638-bf85-1039ceaae7cf tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Getting quotas for project b031042c48094fdcba11a1a647323b94. Resources: {'ram', 'instances', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 15:49:50.667523 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-aec52c8a-e40f-4638-bf85-1039ceaae7cf tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Getting quotas for user af392d5574cd41399105a3ef96f6d0cf and project b031042c48094fdcba11a1a647323b94. Resources: {'ram', 'instances', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 15:49:50.734456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-aec52c8a-e40f-4638-bf85-1039ceaae7cf tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Going to run 1 instances... {{(pid=117998) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 15:49:50.736830 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-aec52c8a-e40f-4638-bf85-1039ceaae7cf tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f6955d8c-de2a-41d4-a8b3-77993f8cdc89',volume_size=None,volume_type=None)] {{(pid=117998) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 15:49:50.877937 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-aec52c8a-e40f-4638-bf85-1039ceaae7cf tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.882968 Jul 15 15:49:50.878826 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 596/1185] 10.222.0.40 () {60 vars in 1146 bytes} [Fri Jul 15 15:49:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 15:49:50.889501 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-74ab1f61-d0b3-4942-837b-c77a9b49761f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:49:50.890140 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-74ab1f61-d0b3-4942-837b-c77a9b49761f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:49:50.892147 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=4 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:49:50.892798 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:49:50.953123 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-74ab1f61-d0b3-4942-837b-c77a9b49761f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:49:50.960521 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-74ab1f61-d0b3-4942-837b-c77a9b49761f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1088 microversion: 2.1 time: 0.075269 Jul 15 15:49:50.961111 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 590/1186] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:49:50 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1088 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:49:51.977260 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3a363e1c-3283-4b33-bcb7-d84f049065b2 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:49:51.977842 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3a363e1c-3283-4b33-bcb7-d84f049065b2 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:49:52.037677 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3a363e1c-3283-4b33-bcb7-d84f049065b2 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:49:52.046043 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3a363e1c-3283-4b33-bcb7-d84f049065b2 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1088 microversion: 2.1 time: 0.072310 Jul 15 15:49:52.046613 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 597/1187] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:49:51 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:49:53.065903 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-1a5fe6da-6e5a-4eb4-bc4f-c2a737d312e1 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:49:53.066638 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-1a5fe6da-6e5a-4eb4-bc4f-c2a737d312e1 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:49:53.124608 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1a5fe6da-6e5a-4eb4-bc4f-c2a737d312e1 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:49:53.133773 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-1a5fe6da-6e5a-4eb4-bc4f-c2a737d312e1 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1088 microversion: 2.1 time: 0.071395 Jul 15 15:49:53.134786 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 591/1188] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:49:53 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1088 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:49:54.151635 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-23a87d0d-9877-465d-8d89-95309e1d1fdf tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:49:54.152243 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-23a87d0d-9877-465d-8d89-95309e1d1fdf tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:49:54.207440 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-23a87d0d-9877-465d-8d89-95309e1d1fdf tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:49:54.215230 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-23a87d0d-9877-465d-8d89-95309e1d1fdf tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1088 microversion: 2.1 time: 0.067829 Jul 15 15:49:54.215819 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 598/1189] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:49:54 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1088 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:49:55.232691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-73d2a531-7b65-4cc3-8d51-9ce194db51c3 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:49:55.233437 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-73d2a531-7b65-4cc3-8d51-9ce194db51c3 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:49:55.240978 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-73d2a531-7b65-4cc3-8d51-9ce194db51c3 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:49:55.241414 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-73d2a531-7b65-4cc3-8d51-9ce194db51c3 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:49:55.242176 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-73d2a531-7b65-4cc3-8d51-9ce194db51c3 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:49:55.242634 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-73d2a531-7b65-4cc3-8d51-9ce194db51c3 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:49:55.306349 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-73d2a531-7b65-4cc3-8d51-9ce194db51c3 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:49:55.314977 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-73d2a531-7b65-4cc3-8d51-9ce194db51c3 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1138 microversion: 2.1 time: 0.086293 Jul 15 15:49:55.315547 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 592/1190] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:49:55 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1138 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:49:56.342108 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ca0bb132-2ed2-4ac4-95a0-f68825dc2ec2 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:49:56.343528 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ca0bb132-2ed2-4ac4-95a0-f68825dc2ec2 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:49:56.351312 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ca0bb132-2ed2-4ac4-95a0-f68825dc2ec2 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:49:56.351752 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ca0bb132-2ed2-4ac4-95a0-f68825dc2ec2 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:49:56.352500 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ca0bb132-2ed2-4ac4-95a0-f68825dc2ec2 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:49:56.352945 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ca0bb132-2ed2-4ac4-95a0-f68825dc2ec2 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:49:56.431190 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ca0bb132-2ed2-4ac4-95a0-f68825dc2ec2 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:49:56.439233 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ca0bb132-2ed2-4ac4-95a0-f68825dc2ec2 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1204 microversion: 2.1 time: 0.102438 Jul 15 15:49:56.439767 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 599/1191] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:49:56 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1204 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:49:57.463283 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e3fb6d4a-05a3-4d91-945f-f4df5917db3d tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:49:57.463957 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e3fb6d4a-05a3-4d91-945f-f4df5917db3d tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:49:57.475707 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e3fb6d4a-05a3-4d91-945f-f4df5917db3d tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:49:57.476239 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e3fb6d4a-05a3-4d91-945f-f4df5917db3d tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:49:57.477089 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e3fb6d4a-05a3-4d91-945f-f4df5917db3d tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:49:57.477602 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e3fb6d4a-05a3-4d91-945f-f4df5917db3d tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:49:57.532807 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-1bc37d70-eda4-4a70-a5bc-8864c16f3066 req-0653dab8-287a-4f01-84de-d1906cf865c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe12e97b-efe5-4b61-a522-de4b210ff3fe", "tag": "81e5b4a1-d80d-4389-b740-bca1826aa492"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:49:57.541393 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-1bc37d70-eda4-4a70-a5bc-8864c16f3066 req-0653dab8-287a-4f01-84de-d1906cf865c3 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:49:57.541853 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-1bc37d70-eda4-4a70-a5bc-8864c16f3066 req-0653dab8-287a-4f01-84de-d1906cf865c3 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:49:57.553872 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-1bc37d70-eda4-4a70-a5bc-8864c16f3066 req-0653dab8-287a-4f01-84de-d1906cf865c3 service nova] Creating event network-changed:81e5b4a1-d80d-4389-b740-bca1826aa492 for instance fe12e97b-efe5-4b61-a522-de4b210ff3fe on hv-cinder-85001 Jul 15 15:49:57.559403 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-1bc37d70-eda4-4a70-a5bc-8864c16f3066 req-0653dab8-287a-4f01-84de-d1906cf865c3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132088 Jul 15 15:49:57.560269 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 593/1192] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:49:57.717743 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e3fb6d4a-05a3-4d91-945f-f4df5917db3d tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:49:57.725900 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e3fb6d4a-05a3-4d91-945f-f4df5917db3d tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1259 microversion: 2.1 time: 0.273096 Jul 15 15:49:57.726552 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 600/1193] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:49:57 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1259 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:49:58.745695 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-5b71e3cc-7415-4e2f-82bc-ee113cdb24c7 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:49:58.746895 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-5b71e3cc-7415-4e2f-82bc-ee113cdb24c7 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:49:58.755220 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5b71e3cc-7415-4e2f-82bc-ee113cdb24c7 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:49:58.755744 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5b71e3cc-7415-4e2f-82bc-ee113cdb24c7 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:49:58.756670 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5b71e3cc-7415-4e2f-82bc-ee113cdb24c7 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:49:58.757200 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5b71e3cc-7415-4e2f-82bc-ee113cdb24c7 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:49:59.006035 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-5b71e3cc-7415-4e2f-82bc-ee113cdb24c7 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:49:59.014757 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-5b71e3cc-7415-4e2f-82bc-ee113cdb24c7 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1259 microversion: 2.1 time: 0.274023 Jul 15 15:49:59.015393 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 594/1194] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:49:58 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1259 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:50:00.031800 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-cfc394aa-d6c3-4c3f-98ec-d998ee6a515f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:50:00.032404 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-cfc394aa-d6c3-4c3f-98ec-d998ee6a515f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:50:00.039332 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cfc394aa-d6c3-4c3f-98ec-d998ee6a515f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:50:00.039787 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cfc394aa-d6c3-4c3f-98ec-d998ee6a515f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:50:00.040555 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cfc394aa-d6c3-4c3f-98ec-d998ee6a515f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:50:00.040949 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cfc394aa-d6c3-4c3f-98ec-d998ee6a515f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:50:00.191295 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-cfc394aa-d6c3-4c3f-98ec-d998ee6a515f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:50:00.200245 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-cfc394aa-d6c3-4c3f-98ec-d998ee6a515f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1259 microversion: 2.1 time: 0.172692 Jul 15 15:50:00.200897 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 601/1195] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:50:00 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:50:01.226614 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-c074007d-6050-4b86-a29a-4d2291a4e6ff tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:50:01.227299 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-c074007d-6050-4b86-a29a-4d2291a4e6ff tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:50:01.235622 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c074007d-6050-4b86-a29a-4d2291a4e6ff tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:50:01.236066 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c074007d-6050-4b86-a29a-4d2291a4e6ff tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:50:01.236828 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c074007d-6050-4b86-a29a-4d2291a4e6ff tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:50:01.237256 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-c074007d-6050-4b86-a29a-4d2291a4e6ff tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:50:01.383787 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-c074007d-6050-4b86-a29a-4d2291a4e6ff tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:50:01.392831 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-c074007d-6050-4b86-a29a-4d2291a4e6ff tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1259 microversion: 2.1 time: 0.170785 Jul 15 15:50:01.393533 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 595/1196] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:50:01 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:50:02.415987 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-aaa87cba-c5ad-4efe-bdd7-196c28e62de1 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:50:02.417607 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-aaa87cba-c5ad-4efe-bdd7-196c28e62de1 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:50:02.419203 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:50:02.426261 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aaa87cba-c5ad-4efe-bdd7-196c28e62de1 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:50:02.426740 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aaa87cba-c5ad-4efe-bdd7-196c28e62de1 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:50:02.427509 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aaa87cba-c5ad-4efe-bdd7-196c28e62de1 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:50:02.427938 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aaa87cba-c5ad-4efe-bdd7-196c28e62de1 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:50:02.568113 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-aaa87cba-c5ad-4efe-bdd7-196c28e62de1 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:50:02.575999 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-aaa87cba-c5ad-4efe-bdd7-196c28e62de1 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1259 microversion: 2.1 time: 0.166353 Jul 15 15:50:02.576812 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 602/1197] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:50:02 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:50:03.594028 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-9d7498bf-8c39-4eb1-8d41-daffbfd2f61c tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:50:03.594835 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-9d7498bf-8c39-4eb1-8d41-daffbfd2f61c tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:50:03.597643 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell0:SELECT=4 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:50:03.605739 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9d7498bf-8c39-4eb1-8d41-daffbfd2f61c tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:50:03.606190 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9d7498bf-8c39-4eb1-8d41-daffbfd2f61c tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:50:03.607373 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9d7498bf-8c39-4eb1-8d41-daffbfd2f61c tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:50:03.608015 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-9d7498bf-8c39-4eb1-8d41-daffbfd2f61c tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:50:03.760613 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-9d7498bf-8c39-4eb1-8d41-daffbfd2f61c tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:50:03.768888 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-9d7498bf-8c39-4eb1-8d41-daffbfd2f61c tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1259 microversion: 2.1 time: 0.180047 Jul 15 15:50:03.769979 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 596/1198] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:50:03 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:50:04.789235 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b1686dbd-9f52-4f47-bd3b-e9b0129313c0 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:50:04.789795 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b1686dbd-9f52-4f47-bd3b-e9b0129313c0 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:50:04.792146 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=10 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:50:04.798704 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b1686dbd-9f52-4f47-bd3b-e9b0129313c0 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:50:04.799146 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b1686dbd-9f52-4f47-bd3b-e9b0129313c0 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:50:04.799914 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b1686dbd-9f52-4f47-bd3b-e9b0129313c0 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:50:04.800342 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b1686dbd-9f52-4f47-bd3b-e9b0129313c0 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:50:04.937878 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b1686dbd-9f52-4f47-bd3b-e9b0129313c0 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:50:04.948554 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b1686dbd-9f52-4f47-bd3b-e9b0129313c0 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1259 microversion: 2.1 time: 0.163156 Jul 15 15:50:04.949140 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 603/1199] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:50:04 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:50:05.969510 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-75355f7b-f845-461d-904c-1eadbd48e95f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:50:05.970272 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-75355f7b-f845-461d-904c-1eadbd48e95f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:50:05.978379 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-75355f7b-f845-461d-904c-1eadbd48e95f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:50:05.978921 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-75355f7b-f845-461d-904c-1eadbd48e95f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:50:05.979859 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-75355f7b-f845-461d-904c-1eadbd48e95f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:50:05.980366 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-75355f7b-f845-461d-904c-1eadbd48e95f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:50:06.125325 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-75355f7b-f845-461d-904c-1eadbd48e95f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:50:06.132926 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-75355f7b-f845-461d-904c-1eadbd48e95f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1259 microversion: 2.1 time: 0.170263 Jul 15 15:50:06.133458 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 597/1200] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:50:05 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:50:07.149931 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e10e90e9-b568-4eef-91bf-1baf748d2076 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:50:07.150548 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e10e90e9-b568-4eef-91bf-1baf748d2076 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:50:07.157520 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e10e90e9-b568-4eef-91bf-1baf748d2076 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:50:07.157986 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e10e90e9-b568-4eef-91bf-1baf748d2076 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:50:07.158784 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e10e90e9-b568-4eef-91bf-1baf748d2076 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:50:07.159212 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e10e90e9-b568-4eef-91bf-1baf748d2076 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:50:07.311081 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e10e90e9-b568-4eef-91bf-1baf748d2076 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:50:07.318961 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e10e90e9-b568-4eef-91bf-1baf748d2076 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1259 microversion: 2.1 time: 0.173143 Jul 15 15:50:07.319521 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 604/1201] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:50:07 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:50:08.103699 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-d90dbf2e-021d-46ca-8586-4fc2befbb3b6 req-84d0a64b-d3a2-4f8f-a569-f4ec2b78b097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe12e97b-efe5-4b61-a522-de4b210ff3fe", "name": "network-vif-plugged", "status": "completed", "tag": "81e5b4a1-d80d-4389-b740-bca1826aa492"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:50:08.112528 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-d90dbf2e-021d-46ca-8586-4fc2befbb3b6 req-84d0a64b-d3a2-4f8f-a569-f4ec2b78b097 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:50:08.113031 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-d90dbf2e-021d-46ca-8586-4fc2befbb3b6 req-84d0a64b-d3a2-4f8f-a569-f4ec2b78b097 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:50:08.130001 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-d90dbf2e-021d-46ca-8586-4fc2befbb3b6 req-84d0a64b-d3a2-4f8f-a569-f4ec2b78b097 service nova] Creating event network-vif-plugged:81e5b4a1-d80d-4389-b740-bca1826aa492 for instance fe12e97b-efe5-4b61-a522-de4b210ff3fe on hv-cinder-85001 Jul 15 15:50:08.135242 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-d90dbf2e-021d-46ca-8586-4fc2befbb3b6 req-84d0a64b-d3a2-4f8f-a569-f4ec2b78b097 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095873 Jul 15 15:50:08.135968 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 598/1202] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:50:08.337459 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-651803b0-ff63-4b33-a43c-a8c92fe7fb6a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:50:08.338089 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-651803b0-ff63-4b33-a43c-a8c92fe7fb6a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:50:08.345712 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-651803b0-ff63-4b33-a43c-a8c92fe7fb6a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:50:08.346151 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-651803b0-ff63-4b33-a43c-a8c92fe7fb6a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:50:08.347199 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-651803b0-ff63-4b33-a43c-a8c92fe7fb6a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:50:08.347637 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-651803b0-ff63-4b33-a43c-a8c92fe7fb6a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:50:08.517093 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-651803b0-ff63-4b33-a43c-a8c92fe7fb6a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:50:08.525083 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-651803b0-ff63-4b33-a43c-a8c92fe7fb6a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1259 microversion: 2.1 time: 0.191581 Jul 15 15:50:08.525688 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 605/1203] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:50:08 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1259 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:50:09.542917 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-b68f7c7c-8d1a-4757-9ac8-a18c2cb75e38 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:50:09.543691 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-b68f7c7c-8d1a-4757-9ac8-a18c2cb75e38 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:50:09.551610 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b68f7c7c-8d1a-4757-9ac8-a18c2cb75e38 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:50:09.552053 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b68f7c7c-8d1a-4757-9ac8-a18c2cb75e38 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:50:09.552822 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b68f7c7c-8d1a-4757-9ac8-a18c2cb75e38 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:50:09.553252 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-b68f7c7c-8d1a-4757-9ac8-a18c2cb75e38 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:50:09.685614 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 15:50:09.686436 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Fri Jul 15 15:50:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 15:50:09.705514 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-b68f7c7c-8d1a-4757-9ac8-a18c2cb75e38 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:50:09.719938 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-b68f7c7c-8d1a-4757-9ac8-a18c2cb75e38 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1259 microversion: 2.1 time: 0.181301 Jul 15 15:50:09.720513 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 599/1204] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:50:09 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1259 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:50:10.738034 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d9c3b3b7-f63e-4815-84b4-25d89383aa98 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:50:10.738700 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d9c3b3b7-f63e-4815-84b4-25d89383aa98 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:50:10.745795 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d9c3b3b7-f63e-4815-84b4-25d89383aa98 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:50:10.746215 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d9c3b3b7-f63e-4815-84b4-25d89383aa98 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:50:10.747319 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d9c3b3b7-f63e-4815-84b4-25d89383aa98 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:50:10.747744 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d9c3b3b7-f63e-4815-84b4-25d89383aa98 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:50:10.889775 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d9c3b3b7-f63e-4815-84b4-25d89383aa98 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:50:10.898135 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d9c3b3b7-f63e-4815-84b4-25d89383aa98 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1444 microversion: 2.1 time: 0.164261 Jul 15 15:50:10.898760 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 606/1205] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:50:10 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1444 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:50:10.915700 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-1fa509f2-55fb-4127-a9ba-a46c62a4ef39 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:50:10.916327 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-1fa509f2-55fb-4127-a9ba-a46c62a4ef39 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:50:10.923722 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1fa509f2-55fb-4127-a9ba-a46c62a4ef39 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:50:10.924164 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1fa509f2-55fb-4127-a9ba-a46c62a4ef39 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:50:10.924936 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1fa509f2-55fb-4127-a9ba-a46c62a4ef39 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:50:10.925581 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-1fa509f2-55fb-4127-a9ba-a46c62a4ef39 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:50:11.073055 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-1fa509f2-55fb-4127-a9ba-a46c62a4ef39 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:50:11.082038 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-1fa509f2-55fb-4127-a9ba-a46c62a4ef39 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1444 microversion: 2.1 time: 0.170181 Jul 15 15:50:11.082669 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 600/1206] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:50:10 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1444 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:50:12.993639 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-538b5dd5-368e-4faf-b87a-eba11686fd6f req-6ebe873d-16d6-439d-b96e-5b94e10957e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe12e97b-efe5-4b61-a522-de4b210ff3fe", "tag": "81e5b4a1-d80d-4389-b740-bca1826aa492"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:50:13.003319 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-538b5dd5-368e-4faf-b87a-eba11686fd6f req-6ebe873d-16d6-439d-b96e-5b94e10957e4 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:50:13.003753 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-538b5dd5-368e-4faf-b87a-eba11686fd6f req-6ebe873d-16d6-439d-b96e-5b94e10957e4 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:50:13.015423 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-538b5dd5-368e-4faf-b87a-eba11686fd6f req-6ebe873d-16d6-439d-b96e-5b94e10957e4 service nova] Creating event network-changed:81e5b4a1-d80d-4389-b740-bca1826aa492 for instance fe12e97b-efe5-4b61-a522-de4b210ff3fe on hv-cinder-85001 Jul 15 15:50:13.021545 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-538b5dd5-368e-4faf-b87a-eba11686fd6f req-6ebe873d-16d6-439d-b96e-5b94e10957e4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031661 Jul 15 15:50:13.022364 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 607/1207] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:51:48.897837 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 15:51:48.898443 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Fri Jul 15 15:51:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 15:52:14.133241 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 15:52:14.133993 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Fri Jul 15 15:52:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 15:52:40.004149 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR oslo.messaging._drivers.impl_rabbit [-] [90354e0a-e252-40ec-89ca-60dbea8fbca7] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 15 15:52:40.004833 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=26 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:52:40.005419 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=46 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:52:40.009382 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-877cc5a7-e964-4c3e-8dcd-e3d2007c3d0f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:52:40.009900 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-877cc5a7-e964-4c3e-8dcd-e3d2007c3d0f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:52:40.016597 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-877cc5a7-e964-4c3e-8dcd-e3d2007c3d0f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:40.017027 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-877cc5a7-e964-4c3e-8dcd-e3d2007c3d0f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:40.017764 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-877cc5a7-e964-4c3e-8dcd-e3d2007c3d0f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:40.018188 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-877cc5a7-e964-4c3e-8dcd-e3d2007c3d0f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:40.040925 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.objects.instance [None req-877cc5a7-e964-4c3e-8dcd-e3d2007c3d0f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lazy-loading 'flavor' on Instance uuid fe12e97b-efe5-4b61-a522-de4b210ff3fe {{(pid=117999) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 15:52:40.115186 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-877cc5a7-e964-4c3e-8dcd-e3d2007c3d0f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "POST /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.112803 Jul 15 15:52:40.115762 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 601/1208] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 15 15:52:40 2022] POST /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:52:40.122401 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR oslo.messaging._drivers.impl_rabbit [-] [907694a4-cb3c-4cf8-8535-43c961baa8ee] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 15 15:52:40.123045 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:52:40.123785 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=52 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:52:40.128327 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-31f55518-e4fc-4920-9829-3c2630693f67 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:52:40.129480 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-31f55518-e4fc-4920-9829-3c2630693f67 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:52:40.137377 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-31f55518-e4fc-4920-9829-3c2630693f67 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:40.137816 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-31f55518-e4fc-4920-9829-3c2630693f67 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:40.138601 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-31f55518-e4fc-4920-9829-3c2630693f67 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:40.139024 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-31f55518-e4fc-4920-9829-3c2630693f67 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:40.327549 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-31f55518-e4fc-4920-9829-3c2630693f67 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:52:40.335792 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-31f55518-e4fc-4920-9829-3c2630693f67 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1569 microversion: 2.1 time: 0.215427 Jul 15 15:52:40.336362 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 608/1209] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:52:40 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1569 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:52:41.355490 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-ed821add-f45a-4166-b272-bf0030e9e5b7 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:52:41.356130 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-ed821add-f45a-4166-b272-bf0030e9e5b7 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:52:41.364720 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ed821add-f45a-4166-b272-bf0030e9e5b7 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:41.365155 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ed821add-f45a-4166-b272-bf0030e9e5b7 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:41.365907 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ed821add-f45a-4166-b272-bf0030e9e5b7 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:41.366332 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-ed821add-f45a-4166-b272-bf0030e9e5b7 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:41.372883 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO oslo.messaging._drivers.impl_rabbit [-] [90354e0a-e252-40ec-89ca-60dbea8fbca7] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 48142. Jul 15 15:52:41.508137 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-ed821add-f45a-4166-b272-bf0030e9e5b7 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:52:41.516216 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-ed821add-f45a-4166-b272-bf0030e9e5b7 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1569 microversion: 2.1 time: 0.166353 Jul 15 15:52:41.516780 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 602/1210] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:52:41 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:52:42.535686 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9b0d43a0-ba9d-4652-881a-1f932b51b45f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:52:42.536410 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9b0d43a0-ba9d-4652-881a-1f932b51b45f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:52:42.545620 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9b0d43a0-ba9d-4652-881a-1f932b51b45f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:42.546060 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9b0d43a0-ba9d-4652-881a-1f932b51b45f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:42.546865 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9b0d43a0-ba9d-4652-881a-1f932b51b45f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:42.547293 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9b0d43a0-ba9d-4652-881a-1f932b51b45f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:42.555329 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO oslo.messaging._drivers.impl_rabbit [-] [907694a4-cb3c-4cf8-8535-43c961baa8ee] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 48146. Jul 15 15:52:42.690977 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9b0d43a0-ba9d-4652-881a-1f932b51b45f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:52:42.699064 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9b0d43a0-ba9d-4652-881a-1f932b51b45f tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1569 microversion: 2.1 time: 0.169208 Jul 15 15:52:42.699620 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 609/1211] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:52:42 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:52:43.716462 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-db2b4dd6-daca-4e12-9f18-41b5ceb2b002 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:52:43.717204 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-db2b4dd6-daca-4e12-9f18-41b5ceb2b002 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:52:43.724323 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-db2b4dd6-daca-4e12-9f18-41b5ceb2b002 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:43.724759 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-db2b4dd6-daca-4e12-9f18-41b5ceb2b002 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:43.725517 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-db2b4dd6-daca-4e12-9f18-41b5ceb2b002 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:43.725933 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-db2b4dd6-daca-4e12-9f18-41b5ceb2b002 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:43.923094 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-db2b4dd6-daca-4e12-9f18-41b5ceb2b002 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:52:43.931976 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-db2b4dd6-daca-4e12-9f18-41b5ceb2b002 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1569 microversion: 2.1 time: 0.219504 Jul 15 15:52:43.932548 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 603/1212] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:52:43 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1569 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:52:44.949966 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e97c737d-1379-404c-bb33-301113f65dd5 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:52:44.950732 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e97c737d-1379-404c-bb33-301113f65dd5 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:52:44.958177 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e97c737d-1379-404c-bb33-301113f65dd5 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:44.958675 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e97c737d-1379-404c-bb33-301113f65dd5 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:44.959439 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e97c737d-1379-404c-bb33-301113f65dd5 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:44.959864 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e97c737d-1379-404c-bb33-301113f65dd5 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:45.095447 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e97c737d-1379-404c-bb33-301113f65dd5 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:52:45.103638 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e97c737d-1379-404c-bb33-301113f65dd5 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1569 microversion: 2.1 time: 0.157638 Jul 15 15:52:45.104187 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 610/1213] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:52:44 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:52:46.120394 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-5804b4e5-f4df-41fa-941c-993d8d7c8309 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:52:46.121010 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-5804b4e5-f4df-41fa-941c-993d8d7c8309 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:52:46.128225 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5804b4e5-f4df-41fa-941c-993d8d7c8309 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:46.128666 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5804b4e5-f4df-41fa-941c-993d8d7c8309 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:46.129570 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5804b4e5-f4df-41fa-941c-993d8d7c8309 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:46.130003 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5804b4e5-f4df-41fa-941c-993d8d7c8309 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:46.265029 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-5804b4e5-f4df-41fa-941c-993d8d7c8309 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:52:46.274080 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-5804b4e5-f4df-41fa-941c-993d8d7c8309 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1569 microversion: 2.1 time: 0.157611 Jul 15 15:52:46.274666 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 604/1214] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:52:46 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:52:47.292093 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7332115a-3e08-47db-9055-b1ecd9d61f46 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:52:47.292738 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7332115a-3e08-47db-9055-b1ecd9d61f46 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:52:47.299925 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7332115a-3e08-47db-9055-b1ecd9d61f46 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:47.300369 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7332115a-3e08-47db-9055-b1ecd9d61f46 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:47.301218 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7332115a-3e08-47db-9055-b1ecd9d61f46 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:47.301647 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7332115a-3e08-47db-9055-b1ecd9d61f46 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:47.442354 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7332115a-3e08-47db-9055-b1ecd9d61f46 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:52:47.450413 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7332115a-3e08-47db-9055-b1ecd9d61f46 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1569 microversion: 2.1 time: 0.162266 Jul 15 15:52:47.451022 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 611/1215] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:52:47 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:52:48.468241 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-3e493174-de72-44c3-996f-975f0b9fcb1a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:52:48.468882 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-3e493174-de72-44c3-996f-975f0b9fcb1a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:52:48.476355 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3e493174-de72-44c3-996f-975f0b9fcb1a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:48.476797 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3e493174-de72-44c3-996f-975f0b9fcb1a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:48.477568 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3e493174-de72-44c3-996f-975f0b9fcb1a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:48.478001 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-3e493174-de72-44c3-996f-975f0b9fcb1a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:48.610789 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-3e493174-de72-44c3-996f-975f0b9fcb1a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:52:48.618740 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-3e493174-de72-44c3-996f-975f0b9fcb1a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1569 microversion: 2.1 time: 0.154502 Jul 15 15:52:48.619303 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 605/1216] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:52:48 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:52:49.636862 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1f1d284e-c885-4e36-abcd-b754a0c35c76 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:52:49.637497 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1f1d284e-c885-4e36-abcd-b754a0c35c76 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:52:49.645233 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1f1d284e-c885-4e36-abcd-b754a0c35c76 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:49.645658 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1f1d284e-c885-4e36-abcd-b754a0c35c76 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:49.646423 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1f1d284e-c885-4e36-abcd-b754a0c35c76 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:49.646887 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1f1d284e-c885-4e36-abcd-b754a0c35c76 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:49.784032 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1f1d284e-c885-4e36-abcd-b754a0c35c76 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:52:49.792022 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1f1d284e-c885-4e36-abcd-b754a0c35c76 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1569 microversion: 2.1 time: 0.159120 Jul 15 15:52:49.792560 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 612/1217] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:52:49 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:52:50.808875 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-2ee481be-1de0-4ca2-93b6-bd2b1531aed9 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:52:50.809584 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-2ee481be-1de0-4ca2-93b6-bd2b1531aed9 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:52:50.817482 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2ee481be-1de0-4ca2-93b6-bd2b1531aed9 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:50.817918 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2ee481be-1de0-4ca2-93b6-bd2b1531aed9 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:50.818732 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2ee481be-1de0-4ca2-93b6-bd2b1531aed9 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:50.819154 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2ee481be-1de0-4ca2-93b6-bd2b1531aed9 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:50.954651 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-2ee481be-1de0-4ca2-93b6-bd2b1531aed9 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:52:50.962899 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-2ee481be-1de0-4ca2-93b6-bd2b1531aed9 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1569 microversion: 2.1 time: 0.158109 Jul 15 15:52:50.963463 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 606/1218] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:52:50 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:52:51.980374 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a8eb88df-3df5-4156-9e43-fef1ae6901ca tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:52:51.980950 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a8eb88df-3df5-4156-9e43-fef1ae6901ca tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:52:51.988236 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a8eb88df-3df5-4156-9e43-fef1ae6901ca tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:51.989334 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a8eb88df-3df5-4156-9e43-fef1ae6901ca tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:51.990103 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a8eb88df-3df5-4156-9e43-fef1ae6901ca tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:51.990553 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a8eb88df-3df5-4156-9e43-fef1ae6901ca tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:52.133857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a8eb88df-3df5-4156-9e43-fef1ae6901ca tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:52:52.141891 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a8eb88df-3df5-4156-9e43-fef1ae6901ca tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1569 microversion: 2.1 time: 0.165504 Jul 15 15:52:52.142427 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 613/1219] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:52:51 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:52:53.160256 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-a93004d8-5722-4401-9b58-5b37cba50c75 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:52:53.160999 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-a93004d8-5722-4401-9b58-5b37cba50c75 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:52:53.168287 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a93004d8-5722-4401-9b58-5b37cba50c75 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:53.168956 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a93004d8-5722-4401-9b58-5b37cba50c75 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:53.170074 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a93004d8-5722-4401-9b58-5b37cba50c75 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:53.170730 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-a93004d8-5722-4401-9b58-5b37cba50c75 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:53.317124 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-a93004d8-5722-4401-9b58-5b37cba50c75 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:52:53.326287 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-a93004d8-5722-4401-9b58-5b37cba50c75 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1570 microversion: 2.1 time: 0.170493 Jul 15 15:52:53.326918 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 607/1220] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:52:53 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:52:53.342808 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6284d47b-21f7-4fd7-bd2c-2be58c7fb7ee tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:52:53.343403 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6284d47b-21f7-4fd7-bd2c-2be58c7fb7ee tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:52:53.350268 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6284d47b-21f7-4fd7-bd2c-2be58c7fb7ee tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:53.350744 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6284d47b-21f7-4fd7-bd2c-2be58c7fb7ee tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:53.351522 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6284d47b-21f7-4fd7-bd2c-2be58c7fb7ee tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:53.351949 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6284d47b-21f7-4fd7-bd2c-2be58c7fb7ee tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:53.438265 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6284d47b-21f7-4fd7-bd2c-2be58c7fb7ee tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [6d3cb44e-a5c2-489d-941d-8241038db6b8] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 15 15:52:54.446128 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO oslo.messaging._drivers.impl_rabbit [None req-6284d47b-21f7-4fd7-bd2c-2be58c7fb7ee tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [6d3cb44e-a5c2-489d-941d-8241038db6b8] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 48176. Jul 15 15:52:54.451961 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6284d47b-21f7-4fd7-bd2c-2be58c7fb7ee tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "POST /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe/action" status: 202 len: 0 microversion: 2.1 time: 1.113102 Jul 15 15:52:54.452745 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 614/1221] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 15 15:52:53 2022] POST /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe/action => generated 0 bytes in 1114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:52:54.462095 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-fa879635-8886-404d-93e1-3127d082de3e tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:52:54.462095 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-fa879635-8886-404d-93e1-3127d082de3e tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:52:54.469240 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fa879635-8886-404d-93e1-3127d082de3e tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:54.469710 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fa879635-8886-404d-93e1-3127d082de3e tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:54.470475 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fa879635-8886-404d-93e1-3127d082de3e tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:54.470931 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-fa879635-8886-404d-93e1-3127d082de3e tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:54.621501 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-fa879635-8886-404d-93e1-3127d082de3e tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:52:54.629613 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-fa879635-8886-404d-93e1-3127d082de3e tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1518 microversion: 2.1 time: 0.172520 Jul 15 15:52:54.630301 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 608/1222] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:52:54 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1518 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:52:55.647997 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e07206e0-06c3-4ec7-9f16-d04655f387d2 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:52:55.648584 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e07206e0-06c3-4ec7-9f16-d04655f387d2 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:52:55.655765 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e07206e0-06c3-4ec7-9f16-d04655f387d2 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:55.656240 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e07206e0-06c3-4ec7-9f16-d04655f387d2 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:55.657033 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e07206e0-06c3-4ec7-9f16-d04655f387d2 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:55.657456 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e07206e0-06c3-4ec7-9f16-d04655f387d2 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:55.816514 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e07206e0-06c3-4ec7-9f16-d04655f387d2 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:52:55.825857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e07206e0-06c3-4ec7-9f16-d04655f387d2 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1520 microversion: 2.1 time: 0.181333 Jul 15 15:52:55.825857 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 615/1223] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:52:55 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:52:56.755853 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-2d96731d-7865-49d6-aebc-3cdd01b666cd req-4d851b21-1605-4a16-9116-abde8f8162cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe12e97b-efe5-4b61-a522-de4b210ff3fe", "name": "network-vif-unplugged", "status": "completed", "tag": "81e5b4a1-d80d-4389-b740-bca1826aa492"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:52:56.769703 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-2d96731d-7865-49d6-aebc-3cdd01b666cd req-4d851b21-1605-4a16-9116-abde8f8162cb service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:56.770140 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-2d96731d-7865-49d6-aebc-3cdd01b666cd req-4d851b21-1605-4a16-9116-abde8f8162cb service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:56.783244 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-2d96731d-7865-49d6-aebc-3cdd01b666cd req-4d851b21-1605-4a16-9116-abde8f8162cb service nova] Creating event network-vif-unplugged:81e5b4a1-d80d-4389-b740-bca1826aa492 for instance fe12e97b-efe5-4b61-a522-de4b210ff3fe on hv-cinder-85001 Jul 15 15:52:56.789375 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-2d96731d-7865-49d6-aebc-3cdd01b666cd req-4d851b21-1605-4a16-9116-abde8f8162cb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038563 Jul 15 15:52:56.790059 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 609/1224] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:52:56.844128 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-74ea6a7c-4e13-4d0d-bc12-3a56b5cc299e tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:52:56.845282 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-74ea6a7c-4e13-4d0d-bc12-3a56b5cc299e tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:52:56.852305 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-74ea6a7c-4e13-4d0d-bc12-3a56b5cc299e tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:56.852823 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-74ea6a7c-4e13-4d0d-bc12-3a56b5cc299e tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:56.853479 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-74ea6a7c-4e13-4d0d-bc12-3a56b5cc299e tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:56.853899 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-74ea6a7c-4e13-4d0d-bc12-3a56b5cc299e tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:57.008920 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-74ea6a7c-4e13-4d0d-bc12-3a56b5cc299e tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:52:57.017085 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-74ea6a7c-4e13-4d0d-bc12-3a56b5cc299e tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1576 microversion: 2.1 time: 0.177120 Jul 15 15:52:57.017569 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 616/1225] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:52:56 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:52:58.035662 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-2763dd7d-2ab9-4a78-98ae-e9e06f483f56 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:52:58.036350 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-2763dd7d-2ab9-4a78-98ae-e9e06f483f56 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:52:58.043444 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2763dd7d-2ab9-4a78-98ae-e9e06f483f56 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:58.043876 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2763dd7d-2ab9-4a78-98ae-e9e06f483f56 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:58.044643 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2763dd7d-2ab9-4a78-98ae-e9e06f483f56 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:58.045069 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-2763dd7d-2ab9-4a78-98ae-e9e06f483f56 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:58.186743 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-2763dd7d-2ab9-4a78-98ae-e9e06f483f56 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:52:58.195927 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-2763dd7d-2ab9-4a78-98ae-e9e06f483f56 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1576 microversion: 2.1 time: 0.164945 Jul 15 15:52:58.196800 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 610/1226] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:52:58 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:52:59.213625 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7d3200db-2ff9-43ff-aba1-95d819639061 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:52:59.214273 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7d3200db-2ff9-43ff-aba1-95d819639061 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:52:59.221751 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7d3200db-2ff9-43ff-aba1-95d819639061 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:59.222228 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7d3200db-2ff9-43ff-aba1-95d819639061 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:59.223072 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7d3200db-2ff9-43ff-aba1-95d819639061 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:52:59.223499 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7d3200db-2ff9-43ff-aba1-95d819639061 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:52:59.363944 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7d3200db-2ff9-43ff-aba1-95d819639061 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:52:59.372064 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7d3200db-2ff9-43ff-aba1-95d819639061 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1576 microversion: 2.1 time: 0.162397 Jul 15 15:52:59.372827 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 617/1227] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:52:59 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:00.389774 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-aa8be3dd-313f-477a-8a72-72f56cab6b50 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:00.390429 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-aa8be3dd-313f-477a-8a72-72f56cab6b50 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:00.397909 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-aa8be3dd-313f-477a-8a72-72f56cab6b50 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:00.398349 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-aa8be3dd-313f-477a-8a72-72f56cab6b50 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:00.399154 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-aa8be3dd-313f-477a-8a72-72f56cab6b50 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:00.399577 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-aa8be3dd-313f-477a-8a72-72f56cab6b50 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:00.541933 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-aa8be3dd-313f-477a-8a72-72f56cab6b50 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:00.550182 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-aa8be3dd-313f-477a-8a72-72f56cab6b50 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1576 microversion: 2.1 time: 0.164283 Jul 15 15:53:00.550816 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 611/1228] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:00 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:01.568502 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-17b2ee3d-20fc-4d56-a575-21a53a9bfb9a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:01.569088 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-17b2ee3d-20fc-4d56-a575-21a53a9bfb9a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:01.575832 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-17b2ee3d-20fc-4d56-a575-21a53a9bfb9a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:01.576278 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-17b2ee3d-20fc-4d56-a575-21a53a9bfb9a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:01.577030 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-17b2ee3d-20fc-4d56-a575-21a53a9bfb9a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:01.577459 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-17b2ee3d-20fc-4d56-a575-21a53a9bfb9a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:01.711865 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-17b2ee3d-20fc-4d56-a575-21a53a9bfb9a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:01.719876 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-17b2ee3d-20fc-4d56-a575-21a53a9bfb9a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1576 microversion: 2.1 time: 0.155545 Jul 15 15:53:01.720438 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 618/1229] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:01 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:02.737283 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-e78d3412-0570-463f-97ee-ae16e608d41b tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:02.737958 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-e78d3412-0570-463f-97ee-ae16e608d41b tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:02.745155 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e78d3412-0570-463f-97ee-ae16e608d41b tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:02.745592 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e78d3412-0570-463f-97ee-ae16e608d41b tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:02.746738 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e78d3412-0570-463f-97ee-ae16e608d41b tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:02.747172 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-e78d3412-0570-463f-97ee-ae16e608d41b tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:02.889156 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-e78d3412-0570-463f-97ee-ae16e608d41b tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:02.896999 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-e78d3412-0570-463f-97ee-ae16e608d41b tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1576 microversion: 2.1 time: 0.163673 Jul 15 15:53:02.897542 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 612/1230] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:02 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:03.913819 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-cb04487b-f709-48ba-8761-f9b19497ed2a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:03.914382 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-cb04487b-f709-48ba-8761-f9b19497ed2a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:03.921667 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cb04487b-f709-48ba-8761-f9b19497ed2a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:03.922110 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cb04487b-f709-48ba-8761-f9b19497ed2a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:03.922934 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cb04487b-f709-48ba-8761-f9b19497ed2a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:03.923376 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cb04487b-f709-48ba-8761-f9b19497ed2a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:04.116524 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-cb04487b-f709-48ba-8761-f9b19497ed2a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:04.124403 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-cb04487b-f709-48ba-8761-f9b19497ed2a tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1576 microversion: 2.1 time: 0.214979 Jul 15 15:53:04.125002 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 619/1231] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:03 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1576 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:05.142147 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-5174acf6-ed0e-4773-8c1e-98c03735bc61 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:05.142748 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-5174acf6-ed0e-4773-8c1e-98c03735bc61 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:05.150087 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5174acf6-ed0e-4773-8c1e-98c03735bc61 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:05.150677 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5174acf6-ed0e-4773-8c1e-98c03735bc61 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:05.151310 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5174acf6-ed0e-4773-8c1e-98c03735bc61 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:05.151737 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-5174acf6-ed0e-4773-8c1e-98c03735bc61 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:05.284584 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-5174acf6-ed0e-4773-8c1e-98c03735bc61 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:05.292550 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-5174acf6-ed0e-4773-8c1e-98c03735bc61 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1576 microversion: 2.1 time: 0.154377 Jul 15 15:53:05.293142 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 613/1232] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:05 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:06.309743 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-13978405-4cab-40f8-a705-1fa7dbbaaec9 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:53:06.310453 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-13978405-4cab-40f8-a705-1fa7dbbaaec9 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:53:06.319026 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-13978405-4cab-40f8-a705-1fa7dbbaaec9 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:06.319469 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-13978405-4cab-40f8-a705-1fa7dbbaaec9 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:06.320286 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-13978405-4cab-40f8-a705-1fa7dbbaaec9 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:06.320752 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-13978405-4cab-40f8-a705-1fa7dbbaaec9 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:06.456137 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-13978405-4cab-40f8-a705-1fa7dbbaaec9 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:53:06.464215 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-13978405-4cab-40f8-a705-1fa7dbbaaec9 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1563 microversion: 2.1 time: 0.158563 Jul 15 15:53:06.464782 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 620/1233] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:53:06 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:53:08.846427 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-4176195e-18f9-4c74-a5db-76a7a5357e0c req-b15bdbec-9715-4702-abbd-dc7dc23fd93d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe12e97b-efe5-4b61-a522-de4b210ff3fe", "name": "network-vif-plugged", "status": "completed", "tag": "81e5b4a1-d80d-4389-b740-bca1826aa492"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:53:08.859316 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-4176195e-18f9-4c74-a5db-76a7a5357e0c req-b15bdbec-9715-4702-abbd-dc7dc23fd93d service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:53:08.859969 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-4176195e-18f9-4c74-a5db-76a7a5357e0c req-b15bdbec-9715-4702-abbd-dc7dc23fd93d service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:53:08.873782 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-4176195e-18f9-4c74-a5db-76a7a5357e0c req-b15bdbec-9715-4702-abbd-dc7dc23fd93d service nova] Creating event network-vif-plugged:81e5b4a1-d80d-4389-b740-bca1826aa492 for instance fe12e97b-efe5-4b61-a522-de4b210ff3fe on hv-cinder-85001 Jul 15 15:53:08.879418 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-4176195e-18f9-4c74-a5db-76a7a5357e0c req-b15bdbec-9715-4702-abbd-dc7dc23fd93d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036911 Jul 15 15:53:08.880285 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 614/1234] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:53:09.770478 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 15:53:09.771150 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Fri Jul 15 15:53:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 15:53:29.695316 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 15:53:29.696457 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Fri Jul 15 15:53:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 15:54:41.544759 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 15:54:41.545404 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Fri Jul 15 15:54:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 15:54:50.999467 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-83b24813-3323-4d6c-b774-183fb3def676 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:51.000040 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-83b24813-3323-4d6c-b774-183fb3def676 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:51.002222 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=28 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:54:51.002891 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:54:51.004329 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR oslo.messaging._drivers.impl_rabbit [-] [90354e0a-e252-40ec-89ca-60dbea8fbca7] AMQP server on 10.222.0.40:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 15 15:54:51.004931 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_api:SELECT=28 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:54:51.005770 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG dbcounter [-] [117999] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:54:51.020222 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-83b24813-3323-4d6c-b774-183fb3def676 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:51.020693 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-83b24813-3323-4d6c-b774-183fb3def676 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:51.021471 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-83b24813-3323-4d6c-b774-183fb3def676 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:51.022890 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-83b24813-3323-4d6c-b774-183fb3def676 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:51.050886 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-83b24813-3323-4d6c-b774-183fb3def676 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Going to try to terminate instance {{(pid=117998) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 15:54:51.083761 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [req-d680046a-8b9f-4b94-b9cc-fdc5d0005a84 req-4c850ebe-2942-4ac6-ad20-fe17e4559d61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe12e97b-efe5-4b61-a522-de4b210ff3fe", "tag": "81e5b4a1-d80d-4389-b740-bca1826aa492"}]} {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:54:51.093001 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-d680046a-8b9f-4b94-b9cc-fdc5d0005a84 req-4c850ebe-2942-4ac6-ad20-fe17e4559d61 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:51.093547 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [req-d680046a-8b9f-4b94-b9cc-fdc5d0005a84 req-4c850ebe-2942-4ac6-ad20-fe17e4559d61 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:51.106752 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.compute.server_external_events [req-d680046a-8b9f-4b94-b9cc-fdc5d0005a84 req-4c850ebe-2942-4ac6-ad20-fe17e4559d61 service nova] Creating event network-changed:81e5b4a1-d80d-4389-b740-bca1826aa492 for instance fe12e97b-efe5-4b61-a522-de4b210ff3fe on hv-cinder-85001 Jul 15 15:54:51.113089 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [req-d680046a-8b9f-4b94-b9cc-fdc5d0005a84 req-4c850ebe-2942-4ac6-ad20-fe17e4559d61 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118062 Jul 15 15:54:51.113952 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 615/1235] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:54:51.140983 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-83b24813-3323-4d6c-b774-183fb3def676 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 204 len: 0 microversion: 2.1 time: 0.149047 Jul 15 15:54:51.141866 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 621/1236] 10.222.0.40 () {58 vars in 1238 bytes} [Fri Jul 15 15:54:50 2022] DELETE /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 15:54:51.154943 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-55c03271-a9de-49c3-9d12-65a6937def2b tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:51.155956 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-55c03271-a9de-49c3-9d12-65a6937def2b tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:51.162312 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-55c03271-a9de-49c3-9d12-65a6937def2b tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:51.162856 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-55c03271-a9de-49c3-9d12-65a6937def2b tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:51.163681 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-55c03271-a9de-49c3-9d12-65a6937def2b tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:51.164335 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-55c03271-a9de-49c3-9d12-65a6937def2b tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:51.303106 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-55c03271-a9de-49c3-9d12-65a6937def2b tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:51.311007 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-55c03271-a9de-49c3-9d12-65a6937def2b tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1569 microversion: 2.1 time: 0.160436 Jul 15 15:54:51.311565 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 616/1237] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:51 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:52.333813 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-54ac05aa-17f8-4a6f-8bf2-e7c26c4d55d9 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:52.334600 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-54ac05aa-17f8-4a6f-8bf2-e7c26c4d55d9 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:52.344510 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-54ac05aa-17f8-4a6f-8bf2-e7c26c4d55d9 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:52.344952 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-54ac05aa-17f8-4a6f-8bf2-e7c26c4d55d9 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:52.345700 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-54ac05aa-17f8-4a6f-8bf2-e7c26c4d55d9 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:52.346125 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-54ac05aa-17f8-4a6f-8bf2-e7c26c4d55d9 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:52.561800 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-54ac05aa-17f8-4a6f-8bf2-e7c26c4d55d9 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:52.569931 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-54ac05aa-17f8-4a6f-8bf2-e7c26c4d55d9 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1569 microversion: 2.1 time: 0.243510 Jul 15 15:54:52.579633 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 622/1238] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:52 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1569 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:53.588117 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-24a0d08e-0381-4470-a93f-2d56fadbe399 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:53.588781 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-24a0d08e-0381-4470-a93f-2d56fadbe399 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:53.600712 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-24a0d08e-0381-4470-a93f-2d56fadbe399 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:53.601406 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-24a0d08e-0381-4470-a93f-2d56fadbe399 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:53.602630 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-24a0d08e-0381-4470-a93f-2d56fadbe399 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:53.603056 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-24a0d08e-0381-4470-a93f-2d56fadbe399 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:53.610338 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO oslo.messaging._drivers.impl_rabbit [-] [90354e0a-e252-40ec-89ca-60dbea8fbca7] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 48268. Jul 15 15:54:53.686253 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-964ca5d7-dfb0-4729-a171-6c3ca1f477bd req-b11de2d5-4b34-405b-a53e-578402941d01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe12e97b-efe5-4b61-a522-de4b210ff3fe", "name": "network-vif-deleted", "tag": "81e5b4a1-d80d-4389-b740-bca1826aa492"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 15:54:53.686837 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.policy [None req-24a0d08e-0381-4470-a93f-2d56fadbe399 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af392d5574cd41399105a3ef96f6d0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031042c48094fdcba11a1a647323b94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117999) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 15:54:53.695280 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-964ca5d7-dfb0-4729-a171-6c3ca1f477bd req-b11de2d5-4b34-405b-a53e-578402941d01 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:53.695663 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-24a0d08e-0381-4470-a93f-2d56fadbe399 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 200 len: 1383 microversion: 2.1 time: 0.111230 Jul 15 15:54:53.695801 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-964ca5d7-dfb0-4729-a171-6c3ca1f477bd req-b11de2d5-4b34-405b-a53e-578402941d01 service nova] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:53.698565 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 617/1239] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:53 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 1383 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 15:54:53.710785 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-964ca5d7-dfb0-4729-a171-6c3ca1f477bd req-b11de2d5-4b34-405b-a53e-578402941d01 service nova] Creating event network-vif-deleted:81e5b4a1-d80d-4389-b740-bca1826aa492 for instance fe12e97b-efe5-4b61-a522-de4b210ff3fe on hv-cinder-85001 Jul 15 15:54:53.715741 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-964ca5d7-dfb0-4729-a171-6c3ca1f477bd req-b11de2d5-4b34-405b-a53e-578402941d01 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033799 Jul 15 15:54:53.716575 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 623/1240] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 15 15:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 15:54:54.717019 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-567fa6a4-71f2-45a9-b9ba-0bf791ca7c96 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '>' {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:54.718438 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.compute.api [None req-567fa6a4-71f2-45a9-b9ba-0bf791ca7c96 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] [instance: fe12e97b-efe5-4b61-a522-de4b210ff3fe] Fetching instance by UUID {{(pid=117999) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 15:54:54.725015 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-567fa6a4-71f2-45a9-b9ba-0bf791ca7c96 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:54.725453 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-567fa6a4-71f2-45a9-b9ba-0bf791ca7c96 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:54.726227 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-567fa6a4-71f2-45a9-b9ba-0bf791ca7c96 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 15:54:54.726711 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG oslo_concurrency.lockutils [None req-567fa6a4-71f2-45a9-b9ba-0bf791ca7c96 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Lock "11a29c77-701d-47b2-97de-2677c43340d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 15:54:54.740234 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.wsgi [None req-567fa6a4-71f2-45a9-b9ba-0bf791ca7c96 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] HTTP exception thrown: Instance fe12e97b-efe5-4b61-a522-de4b210ff3fe could not be found. Jul 15 15:54:54.741940 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-567fa6a4-71f2-45a9-b9ba-0bf791ca7c96 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Request method failure captured: Jul 15 15:54:54.741940 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: request: GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe HTTP/1.1 Jul 15 15:54:54.741940 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept: application/json Jul 15 15:54:54.741940 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Accept-Encoding: identity Jul 15 15:54:54.741940 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Connection: close Jul 15 15:54:54.741940 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Length: 0 Jul 15 15:54:54.741940 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Content-Type: application/json Jul 15 15:54:54.741940 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Host: 10.222.0.40 Jul 15 15:54:54.741940 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Openstack-System-Scope: None Jul 15 15:54:54.741940 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: User-Agent: python-urllib3/1.26.9 Jul 15 15:54:54.741940 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Auth-Token: gAAAAABi0YyBluUU-_FGhOlV0wiN3QSo8mVAKh4PnuB0ZRmgTX2mQd1zn5oicGgJJmGvlQC1O10znnosywVfpL4b4LQjqn4ZeLbnlr_aJnEGUOILQD2No_qDm0Z3zTEHgi60EICkEUNBP_TFdFdnMufFona1aI_kWWNEK3dedh4IQI1n9---U0U Jul 15 15:54:54.741940 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Id: None Jul 15 15:54:54.741940 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Domain-Name: None Jul 15 15:54:54.741940 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Identity-Status: Confirmed Jul 15 15:54:54.741940 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Is-Admin-Project: True Jul 15 15:54:54.741940 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Id: default Jul 15 15:54:54.741940 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Domain-Name: Default Jul 15 15:54:54.741940 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Id: b031042c48094fdcba11a1a647323b94 Jul 15 15:54:54.741940 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Project-Name: tempest-TestShelveInstance-506967063 Jul 15 15:54:54.741940 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Role: member,reader Jul 15 15:54:54.741940 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Roles: member,reader Jul 15 15:54:54.744167 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b031042c48094fdcba11a1a647323b94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b031042c48094fdcba11a1a647323b94", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b031042c48094fdcba11a1a647323b94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b031042c48094fdcba11a1a647323b94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}] Jul 15 15:54:54.744167 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant: tempest-TestShelveInstance-506967063 Jul 15 15:54:54.744167 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Id: b031042c48094fdcba11a1a647323b94 Jul 15 15:54:54.744167 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-Tenant-Name: tempest-TestShelveInstance-506967063 Jul 15 15:54:54.744167 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User: tempest-TestShelveInstance-506967063-project Jul 15 15:54:54.744167 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Id: default Jul 15 15:54:54.744167 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Domain-Name: Default Jul 15 15:54:54.744167 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Id: af392d5574cd41399105a3ef96f6d0cf Jul 15 15:54:54.744167 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: X-User-Name: tempest-TestShelveInstance-506967063-project Jul 15 15:54:54.744167 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: method: > Jul 15 15:54:54.744167 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: exception: Instance fe12e97b-efe5-4b61-a522-de4b210ff3fe could not be found. Jul 15 15:54:54.744167 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: action_args: {'id': 'fe12e97b-efe5-4b61-a522-de4b210ff3fe'} Jul 15 15:54:54.745336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: {{(pid=117999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 15:54:54.745336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:54:54.745336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 15:54:54.745336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 15:54:54.745336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 15:54:54.745336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 15:54:54.745336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 15:54:54.745336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 15:54:54.745336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 15:54:54.745336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 15:54:54.745336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe12e97b-efe5-4b61-a522-de4b210ff3fe could not be found. Jul 15 15:54:54.745336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:54:54.745336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:54:54.745336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:54:54.745336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:54:54.745336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:54:54.745336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:54:54.745336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 15:54:54.745336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 15:54:54.745336 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 15:54:54.747177 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 15:54:54.747177 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 15:54:54.747177 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 15:54:54.747177 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 15:54:54.747177 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 15:54:54.747177 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 15:54:54.747177 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 15:54:54.747177 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe12e97b-efe5-4b61-a522-de4b210ff3fe could not be found. Jul 15 15:54:54.747177 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:54:54.747177 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 15:54:54.747177 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:54:54.747177 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 15:54:54.747177 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 15:54:54.747177 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 15:54:54.747177 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 15:54:54.747177 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 15:54:54.747177 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe12e97b-efe5-4b61-a522-de4b210ff3fe could not be found. Jul 15 15:54:54.747177 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: ERROR nova.api.openstack.wsgi Jul 15 15:54:54.748990 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: DEBUG nova.api.openstack.wsgi [None req-567fa6a4-71f2-45a9-b9ba-0bf791ca7c96 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Returning 404 to user: Instance fe12e97b-efe5-4b61-a522-de4b210ff3fe could not be found. {{(pid=117999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 15:54:54.748990 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO nova.api.openstack.requestlog [None req-567fa6a4-71f2-45a9-b9ba-0bf791ca7c96 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe" status: 404 len: 111 microversion: 2.1 time: 0.032533 Jul 15 15:54:54.748990 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: [pid: 117999|app: 0|req: 618/1241] 10.222.0.40 () {58 vars in 1235 bytes} [Fri Jul 15 15:54:54 2022] GET /compute/v2.1/servers/fe12e97b-efe5-4b61-a522-de4b210ff3fe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 15:54:54.948439 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a23028fb-89c4-446e-9fd8-3a37cb9e2c50 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] Calling method '.version_select at 0x7fe3c6a9f160>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 15:54:54.972842 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a23028fb-89c4-446e-9fd8-3a37cb9e2c50 tempest-TestShelveInstance-506967063 tempest-TestShelveInstance-506967063-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-455271369" status: 202 len: 0 microversion: 2.1 time: 0.039420 Jul 15 15:54:54.977221 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 624/1242] 10.222.0.40 () {58 vars in 1250 bytes} [Fri Jul 15 15:54:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-455271369 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 15:55:08.907327 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 15:55:08.907883 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Fri Jul 15 15:55:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 15:57:14.144991 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 15:57:14.149817 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Fri Jul 15 15:57:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 15:58:01.554074 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 15:58:01.555394 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Fri Jul 15 15:58:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 15:58:09.093167 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 15:58:09.093738 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Fri Jul 15 15:58:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 15:58:09.784582 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 15:58:09.784980 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Fri Jul 15 15:58:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 15:58:28.916756 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 15:58:28.917580 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Fri Jul 15 15:58:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 16:00:09.711567 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 16:00:09.712284 dv-cinder-850015-1-iscsi devstack@n-api.service[117998]: Fri Jul 15 16:00:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 16:00:34.161713 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 16:00:34.162941 dv-cinder-850015-1-iscsi devstack@n-api.service[117999]: Fri Jul 15 16:00:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!